-- Logs begin at Mon 2021-12-13 16:07:30 UTC, end at Mon 2021-12-13 17:11:07 UTC. -- Dec 13 16:39:52.886633 dv-cinder-821602-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 13 16:39:52.896483 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 13 16:39:52 2021] *** Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: nodename: dv-cinder-821602-2-iscsi Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: machine: x86_64 Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: clock source: unix Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: pcre jit disabled Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: detected number of CPU cores: 4 Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: current working directory: / Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: detected binary path: /usr/bin/uwsgi-core Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: your processes number limit is 47680 Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: your memory page size is 4096 bytes Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: detected max file descriptor number: 2048 Dec 13 16:39:52.899643 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: lock engine: pthread robust mutexes Dec 13 16:39:52.900417 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: thunder lock: enabled Dec 13 16:39:52.900417 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 13 16:39:52.900417 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 13 16:39:52.944594 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: Python main interpreter initialized at 0x562a6fcbb9c0 Dec 13 16:39:52.944594 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: python threads support enabled Dec 13 16:39:52.944594 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: your server socket listen backlog is limited to 100 connections Dec 13 16:39:52.944594 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: your mercy for graceful operations on workers is 90 seconds Dec 13 16:39:52.944950 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: mapped 403077 bytes (393 KB) for 2 cores Dec 13 16:39:52.945024 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: *** Operational MODE: preforking *** Dec 13 16:39:52.945278 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: *** uWSGI is running in multiple interpreter mode *** Dec 13 16:39:52.945278 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: spawned uWSGI master process (pid: 108697) Dec 13 16:39:52.945483 dv-cinder-821602-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 13 16:39:52.947369 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: spawned uWSGI worker 1 (pid: 108698, cores: 1) Dec 13 16:39:52.947369 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: spawned uWSGI worker 2 (pid: 108699, cores: 1) Dec 13 16:39:52.947369 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 13 16:39:54.664542 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:39:54.664542 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: from cryptography.utils import int_from_bytes Dec 13 16:39:54.665227 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:39:54.665227 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: from cryptography.utils import int_from_bytes Dec 13 16:39:54.689522 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:39:54.689522 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: from cryptography.utils import int_from_bytes Dec 13 16:39:54.690109 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:39:54.690109 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: from cryptography.utils import int_from_bytes Dec 13 16:39:57.239908 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 16:39:57.240515 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 16:39:57.240638 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 16:39:57.240995 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 16:39:57.241248 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 16:39:57.241626 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.241948 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.242261 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.242579 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.242902 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.243209 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.243499 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.243824 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.244147 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.244402 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.244739 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.245060 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-2-iscsi {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.245376 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.245675 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.245962 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.246274 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.246592 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.246885 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.247195 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.247685 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.248983 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.248983 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.248983 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.249406 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.249543 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.249792 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.250110 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.250411 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.250727 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.251033 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.251425 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-2-iscsi {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.251743 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.252052 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.252360 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.252795 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.253106 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.253410 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.253725 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.254047 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.254138 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 16:39:57.254564 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 16:39:57.254648 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.254648 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.254806 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 16:39:57.254957 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.255155 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 16:39:57.255283 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.255406 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 16:39:57.255574 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.255736 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.255859 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.256400 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.256531 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.256760 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.256891 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.257082 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.257213 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.257401 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.257521 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.257698 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.257820 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.257944 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.258075 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.258237 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.258363 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.258553 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.258674 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.258869 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.259104 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.259227 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.259342 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.259463 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.259586 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-2-iscsi {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.259712 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.259856 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.259977 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.260109 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.260237 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.260367 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.260539 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.260703 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.260865 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.260985 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.261166 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.261298 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.261468 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.261601 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.261771 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.262075 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.262161 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.262376 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.262462 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.262677 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.262770 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.262986 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.263071 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.263291 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.263375 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.263605 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.263695 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.263994 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.264094 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.264308 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.264474 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.264721 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.264972 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.265061 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.265278 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.265371 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.265602 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.265685 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.265912 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.266005 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-2-iscsi {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.266210 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.266297 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.266520 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.266614 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.266841 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.266929 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.267141 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.267300 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.267438 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.267614 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.267738 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.267929 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.268050 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.268251 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.268379 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.268610 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.268712 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.268911 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.268997 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.269219 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.269310 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.269519 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.269612 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.269830 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.269923 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.270133 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.270225 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.270434 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.270525 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.270734 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.270873 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.271027 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.271119 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.271331 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.271417 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.271629 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.271727 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.271930 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.272014 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.272179 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.272263 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.272485 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.272598 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.272825 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.272919 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.273127 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.273223 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.273425 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.273530 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.273688 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.273772 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.273937 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.274031 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.274249 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.274335 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.274567 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.274654 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.274874 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.274959 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.275176 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.275257 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.275475 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.275577 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.275777 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.275938 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.276080 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.276246 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.276385 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.276549 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.276714 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.276881 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.277021 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.277179 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.277340 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.277477 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.277651 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.277790 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.277967 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.278093 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.278272 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.278393 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.278587 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.278704 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.278978 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.279062 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.279227 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.279311 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.279562 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.279660 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.279922 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.280357 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.280440 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.280678 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.280768 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.280980 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.281068 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.281278 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.281362 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.281577 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.281662 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.281872 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.281959 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.282170 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.282254 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.282462 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.282555 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.282806 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.282912 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.283085 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.283171 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.283385 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.283478 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.283677 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.283762 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.283974 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.284063 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.284276 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.284439 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.284611 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.284698 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.284923 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.285010 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.285229 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.285322 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.285535 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.285623 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.285832 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.285923 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.286137 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.286223 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.286443 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.286528 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.286750 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.286842 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.287056 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.287140 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.287361 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.287451 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.287665 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.287748 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.287969 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.288052 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.288272 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.288356 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.288591 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.288725 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.288972 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.289089 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.289226 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.289352 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.289535 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.289627 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.289837 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.289928 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.290142 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.290227 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.290445 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.290539 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.290758 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.290843 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.291064 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.291146 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.291367 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.291464 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.291673 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.291770 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.291975 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.292059 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.292276 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.292373 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.292605 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.292694 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.292912 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.293011 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.293222 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.293316 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.293536 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.293621 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.293832 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.293924 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.294138 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.294238 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.294445 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.294528 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.294746 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.294829 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.295048 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.295204 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.295585 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.295865 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.295957 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.296184 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.296282 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.296496 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.296596 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.296835 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.296930 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.297137 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.297237 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.297435 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.297521 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.297734 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.297817 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.298030 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.298127 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.298347 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.298439 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.298657 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.298751 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.298959 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.299051 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.299263 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.299348 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.299574 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.299660 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:39:57.299879 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.299973 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.300183 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.300276 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.300480 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.300622 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.300809 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.300898 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.301114 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.301199 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.301413 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.301497 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.301733 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.301820 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.302040 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.302137 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.302342 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.302435 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.302659 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.302746 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.302960 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.303046 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.303258 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.303342 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.303567 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.303655 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.303872 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.303958 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.304182 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.304302 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.304491 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.304605 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.304830 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.304920 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.305139 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.305236 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.305445 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.305532 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.305771 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.305867 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.306085 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.306260 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.306388 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.306496 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.306705 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.306791 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.307011 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.307104 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.307325 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.307417 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.307624 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.307719 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.307929 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.308022 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.308232 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.308325 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.308555 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.308712 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.308865 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.308960 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.309175 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.309260 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.309476 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.309562 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.309780 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.309866 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.310080 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.310174 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.310382 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.310468 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.310682 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.310775 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.311060 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.311303 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.311388 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.311657 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.311892 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.311976 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.312216 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.312308 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.312525 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.312653 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.312860 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.312946 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.313167 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.313251 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.313483 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.313577 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.313788 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.313873 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.314110 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.314196 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.314422 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.314518 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.314731 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.314816 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.315034 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.315119 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.315343 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.315436 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.315651 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.315776 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.315955 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.316039 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.316276 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.316397 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.316615 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.316728 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.316897 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.317007 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.317199 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.317314 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.317517 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.317627 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.317828 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.317936 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.318133 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.318251 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.318431 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.318545 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.318744 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.318862 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.319047 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.319154 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.319360 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.319475 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.319669 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.319788 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.319980 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.320096 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.320283 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.320397 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.320607 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.320741 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.320914 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.321023 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.321249 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.321360 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.321512 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.321602 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.321818 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.321903 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.322131 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.322216 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.322436 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.322522 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.322751 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.322835 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.323054 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.323147 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.323368 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.323452 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.323670 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.323760 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.323973 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.324074 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.324268 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.324352 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.324591 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.324677 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.324897 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.325000 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.325200 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.325295 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.325504 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.325589 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.325806 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.325900 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.326108 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.326192 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.326501 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.326589 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.326811 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.327118 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.327203 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.327421 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.327512 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.327723 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.327815 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.328029 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.328120 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.328338 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.328430 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.328668 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.328777 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.328974 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.329060 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.329276 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.329361 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.329584 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.329678 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.329887 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.329980 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.330186 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.330302 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.330485 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.330616 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.330793 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.330931 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.331109 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.331253 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.331418 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.331529 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.331733 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.331851 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.332048 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.332157 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.332350 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.332475 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.332670 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.332781 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.332988 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.333098 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.333290 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.333401 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.333590 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.333699 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.333890 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.334008 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.334189 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.334305 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.334544 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.334672 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.334828 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.335021 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.335127 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.335237 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.335421 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.335531 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.335733 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.335855 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.336037 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.336152 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.336345 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.336461 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.336669 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.336779 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.336972 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.337058 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.337287 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.337372 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.337593 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.337687 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.337897 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.337989 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.338202 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.338288 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.338508 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.338592 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.338811 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.338894 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.339116 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.339200 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.339427 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.339519 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.339728 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.339814 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.340033 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.340124 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.340332 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.340425 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.340653 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.340741 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.340952 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.341036 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.341262 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.341348 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.341593 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.341839 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.341932 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.342216 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.342487 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.342572 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.342888 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.343130 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.343218 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.343447 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.343534 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.343761 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.343854 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.344069 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.344160 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.344375 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.344462 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.344697 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.344794 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.345003 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.345091 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.345305 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.345393 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.345605 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.345691 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.345908 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.346002 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.346206 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.346293 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.346504 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.346590 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.346800 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.346897 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.347103 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.347187 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.347398 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.347484 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.347697 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.347791 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.348020 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.348113 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.348318 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.348417 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.348652 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.348741 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.348953 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.349041 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.349256 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.349341 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.349553 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.349644 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.349870 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.349955 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.350176 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.350269 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.350480 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.350566 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.350785 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.350871 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.351113 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.351197 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.351421 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.351514 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.351722 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.351807 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.352033 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.352118 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.352350 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.352444 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.352679 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.352770 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.352993 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.353086 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.353292 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.353386 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.353594 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.353678 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.353896 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.353981 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.354197 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.354290 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.354496 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.354582 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.354800 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.354896 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.355103 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.355191 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.355400 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.355494 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.355705 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.355788 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.356009 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.356093 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.356310 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.356394 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.356627 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.356736 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.356924 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.357011 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.357222 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.357313 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.357515 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.357663 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.357908 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.358210 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.358339 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.358513 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.358810 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.358925 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.359112 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.359266 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.359414 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.359587 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.359710 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.359908 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.360014 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.360231 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.360316 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.360551 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.360658 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.360903 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.360990 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.361199 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.361284 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.361496 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.361661 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.361798 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.361883 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.362097 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.362182 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.362394 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.362493 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.362701 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.362786 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.363004 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.363088 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.363301 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.363400 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.363598 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.363685 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.363897 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.363988 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.364194 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.364291 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.364492 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.364625 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.364823 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.364947 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.365139 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.365236 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.365437 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.365532 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.365732 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.365818 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.366034 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.366120 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.366331 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.366418 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.366628 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.366837 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.366930 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.367018 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.367208 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.367301 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.367503 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.367589 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.367801 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.367899 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.368099 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.368184 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.368398 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.368484 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.368713 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.368817 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.369034 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.369122 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.369336 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.369421 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.369634 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.369728 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.369934 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.370019 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.370233 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.370330 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.370569 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.370657 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.370868 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.370954 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.371178 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.371270 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.371478 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.371571 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.371783 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.371868 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.372087 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.372173 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.372386 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.372479 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.372718 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.372808 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.373033 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.373118 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.373450 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.373540 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.373764 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.374103 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.374237 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.374380 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.374550 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.374678 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.374861 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.374968 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.375166 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.375272 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.375480 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.375566 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.375788 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.375880 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.376090 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.376184 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.376391 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.376478 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.376726 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.376935 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.377024 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.377122 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.377322 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.377409 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.377627 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.377713 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.377928 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.378014 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.378234 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.378342 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.378534 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.378618 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.378839 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.379141 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.379237 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.379448 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.379539 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.379751 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.379851 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.380053 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.380140 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.380363 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.380478 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.380688 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.380790 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.381313 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.381420 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.381617 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.381703 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.381920 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.382006 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.382220 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.382304 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.382520 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.382612 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.382818 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.382954 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.383120 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.383206 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.383421 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.383506 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.383724 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.383810 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.384021 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.384106 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.384318 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.384447 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.384641 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.384764 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.384945 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.385073 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.385250 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.385379 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.385545 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.385683 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.385845 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.385990 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.386143 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.386301 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.386442 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.386610 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.386741 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.386983 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.387081 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.387320 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.387408 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.387628 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.387713 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.387928 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.388013 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.388229 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.388316 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.388524 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.388655 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.388880 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.388985 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.389176 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.389577 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.389727 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.389890 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.390039 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.390193 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.390358 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.390493 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.390680 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.390813 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.390998 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.391117 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.391313 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.391432 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.391627 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.391841 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.391929 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.392150 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.392237 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.392448 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.392542 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.392869 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.392964 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.393174 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.393266 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.393479 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.393572 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.393793 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.393886 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.394103 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.394188 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.394415 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.394506 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.394715 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.394807 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.395023 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.395107 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.395331 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.395428 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.395644 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.395741 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.395953 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.396051 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.396258 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.396342 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.396560 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.396690 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.396881 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.396973 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.397191 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.397288 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.397499 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.397586 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.397803 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.397886 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.398108 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.398199 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.398418 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.398512 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.398727 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.398812 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.399030 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.399124 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.399338 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.399425 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.399643 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.399735 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.399945 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.400042 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.400266 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.400351 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.400587 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.400676 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.400889 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.400984 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.401188 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.401272 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.401491 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.401575 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.401792 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.401886 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.402092 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.402176 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.402395 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.402517 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.402699 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.402827 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.402997 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.403140 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.403297 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.403441 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.403611 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.403750 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.403910 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.404060 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.404224 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.404373 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.404668 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.405041 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.405209 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.405361 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.405508 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.405666 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.405930 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.406018 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.406245 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.406329 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.406556 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.406641 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.406862 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.406948 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.407178 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.407306 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.407465 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.407564 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.407775 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.407862 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.408094 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.408188 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.408394 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.408480 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.408721 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.408812 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.409025 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.409112 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.409347 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.409433 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.409650 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.409744 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.409965 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.410052 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.410278 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.410454 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.410595 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.410765 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.410894 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.411067 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.411191 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.411477 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.411562 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.411781 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.411866 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.412081 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.412167 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.412378 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.412476 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.412700 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.412788 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.412997 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.413084 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.413295 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.413404 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.413593 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.413686 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.413910 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.414004 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.414209 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.414304 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.414524 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.414618 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.414827 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.414920 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.415126 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.415221 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.415423 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.415507 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.415719 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.415804 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.416049 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.416134 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.416348 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.416433 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.416688 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.416778 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.417008 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.417095 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.417348 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.417446 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.417650 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.417736 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.417960 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.418048 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.418278 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.418365 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.418596 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.418681 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.418894 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.418979 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.419201 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.419287 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.419506 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.419604 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.419809 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.419901 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.420187 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.420275 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.420510 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.420850 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.421025 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.421161 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.421325 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.421473 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.421643 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.421783 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.421955 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.422263 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.422347 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.422571 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.422658 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.422896 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.422984 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.423203 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.423288 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.423514 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.423608 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.423828 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.423914 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.424140 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.424226 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.424451 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.424549 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.424780 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.424927 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.425101 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.425245 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.425410 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.425553 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.425716 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.425878 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.426019 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.426196 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.426323 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.426516 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.426661 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.426851 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.426965 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.427165 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.427284 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.427484 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.427612 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.427796 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.427928 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.428112 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.428245 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.428467 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.428557 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.428807 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.428902 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.429110 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.429204 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.429419 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.429512 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.429729 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.429817 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.430041 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.430137 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.430349 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.430435 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.430659 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.430744 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.430969 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.431056 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.431269 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.431355 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.431571 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.431656 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.431874 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.431961 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.432174 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.432260 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.432476 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.432599 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.432800 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.432885 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.433124 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.433209 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.433427 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.433530 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.433737 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.433828 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.434044 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.434128 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.434348 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.434442 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.434650 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.434863 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.434948 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.435172 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.435302 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.435497 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.435583 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.435915 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.436075 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.436237 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.436556 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.436811 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.436906 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.437149 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.437235 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.437483 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.437596 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.437784 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.437881 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.438091 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.438177 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.438395 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.438489 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.438693 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.438779 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.439008 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.439092 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.439314 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.439401 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.439615 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.439701 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.439928 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.440021 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.440234 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.440327 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.440547 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.440781 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.440871 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.441126 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.441227 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.441438 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.441525 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.441758 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.442005 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.442090 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.442338 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.442425 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.442654 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.442751 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.442969 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.443065 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.443269 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.443354 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.443567 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.443684 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.443877 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.443976 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.444182 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.444267 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.444482 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.444603 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.444803 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.444907 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.445109 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.445195 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.445411 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.445507 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.445707 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.445809 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.446011 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.446099 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.446309 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.446397 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.446635 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.446722 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.446937 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.447023 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.447236 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.447348 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.447533 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.447661 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.447850 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.447966 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.448154 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.448260 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.448452 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.448545 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.448779 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.448869 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.449081 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.449180 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.449430 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.449531 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.449683 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.449769 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.449985 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.450079 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.450286 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.450379 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.450594 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.450680 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.450940 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.451035 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.451250 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.451368 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.451760 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.452016 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.452124 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.452350 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.452437 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.452695 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.452785 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.453013 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.453113 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.453321 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.453408 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.453644 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.453739 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.453952 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.454048 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.454260 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.454354 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.454600 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.454782 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.454916 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.455098 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.455431 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.455522 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.455757 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.455844 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.456082 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.456170 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.456399 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.456492 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.456743 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.456830 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.457113 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.457218 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.457361 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.457455 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.457663 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.457758 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.457972 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.458069 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.458277 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.458364 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.458579 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.458672 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.458884 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.458970 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.459193 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.459278 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.459495 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.459588 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.459800 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.459897 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.460105 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.460189 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.460407 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.460661 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.460754 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.461014 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.461102 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.461332 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.461418 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.461656 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.461755 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.461971 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.462056 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.462284 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.462382 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.462588 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.462673 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.462892 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.462986 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.463196 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.463297 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.463501 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.463598 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.463803 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.463888 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.464112 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.464274 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.464417 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.464504 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.464753 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.464841 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.465053 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.465149 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.465358 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.465465 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.465658 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.465777 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.465967 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.466090 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.466270 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.466417 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.466598 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.466716 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.466899 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.467111 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.467434 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.467729 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.467857 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.468056 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.468165 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.468359 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.468450 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.468698 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.468792 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.469008 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.469112 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.469317 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.469415 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.469622 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.469711 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.469931 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.470018 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.470230 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.470319 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.470528 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.470618 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.470832 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.470919 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.471144 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.471232 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.471447 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.471617 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.471757 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.471859 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.472062 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.472157 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.472366 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.472461 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.472698 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.472800 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.473007 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.473095 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.473320 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.473421 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.473628 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.473722 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.473948 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.474035 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.474259 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.474354 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.474570 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.474656 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.474879 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.474964 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.475190 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.475284 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.475500 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.475734 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.475819 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.476096 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.476203 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.476402 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.476495 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.476747 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.476835 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.477070 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.477178 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.477372 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.477458 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.477678 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.477763 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.477982 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.478080 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.478302 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.478392 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.478612 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.478705 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.478917 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.479010 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.479222 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.479308 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.479531 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.479623 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.479837 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.479935 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.480143 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.480233 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.480446 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.480532 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.480781 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.480880 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.481090 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.481179 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.481401 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.481496 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.481719 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.481804 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.482042 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.482127 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.482355 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.482448 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.482994 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.483093 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.483290 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.483424 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.483634 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.483772 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.483963 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.484111 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.484276 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.484445 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.484605 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.484804 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.484911 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.485139 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.485224 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 16:39:57.485485 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.485810 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.486127 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.486552 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.486874 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.487200 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.487528 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.487843 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.488167 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.488494 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.488835 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.489160 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.489473 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.489803 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.490188 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.490477 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.490803 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.491110 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.491414 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.491718 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.492027 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.492355 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.492718 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.493042 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.493365 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.493678 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.493997 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.494304 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.494622 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.494942 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.495258 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.495570 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.495901 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.496211 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.496521 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.496857 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.497166 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.497474 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.497781 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.498103 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.498461 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.498763 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.499086 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.499404 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.499722 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.500037 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.500346 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.500697 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.501008 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.501323 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.501634 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.501943 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.502259 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.502572 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.502896 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.503528 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.503878 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.504363 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.504766 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.505067 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.505412 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.505739 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.506391 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.506706 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.507005 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:39:57.507247 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 16:39:57.508466 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG oslo_db.sqlalchemy.engines [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:39:57.530313 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_db.sqlalchemy.engines [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:39:57.573515 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.context [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31ce76d4-9fe4-4b8d-a79f-c827d49740a3(cell1) {{(pid=108698) load_cells /opt/stack/nova/nova/context.py:464}} Dec 13 16:39:57.578014 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG oslo_concurrency.lockutils [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:39:57.579589 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG oslo_concurrency.lockutils [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:39:57.580375 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG oslo_concurrency.lockutils [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:39:57.582357 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG oslo_concurrency.lockutils [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:39:57.592930 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG oslo_db.sqlalchemy.engines [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:39:57.595357 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.context [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31ce76d4-9fe4-4b8d-a79f-c827d49740a3(cell1) {{(pid=108699) load_cells /opt/stack/nova/nova/context.py:464}} Dec 13 16:39:57.595705 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG oslo_db.sqlalchemy.engines [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:39:57.599910 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:39:57.601774 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:39:57.602581 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:39:57.604513 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:39:57.617148 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_db.sqlalchemy.engines [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:39:57.619939 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_db.sqlalchemy.engines [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:39:57.763941 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG oslo_db.sqlalchemy.engines [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:39:57.789080 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_db.sqlalchemy.engines [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:39:58.101054 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: WARNING keystonemiddleware.auth_token [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 16:39:58.103278 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: WARNING keystonemiddleware.auth_token [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 16:39:58.107506 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: WARNING keystonemiddleware.auth_token [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 16:39:58.109996 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: WARNING keystonemiddleware.auth_token [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 16:39:58.448435 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: WARNING keystonemiddleware.auth_token [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 16:39:58.453251 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: WARNING keystonemiddleware.auth_token [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 16:39:58.453833 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: WARNING keystonemiddleware.auth_token [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 16:39:58.458379 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: WARNING keystonemiddleware.auth_token [None req-9665b3f4-133d-4527-b266-eb760f67a30d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 16:39:58.458971 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a6fcbb9c0 pid: 108698 (default app) Dec 13 16:39:58.461066 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:39:58.462237 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Dec 13 16:39:58.462659 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Mon Dec 13 16:39:58 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:39:58.463606 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a6fcbb9c0 pid: 108699 (default app) Dec 13 16:41:21.106289 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:21.107339 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Dec 13 16:41:21.109076 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:21.531240 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-02bc2f08-01ad-489c-8daf-0f21e9d86208 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:21.566213 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-02bc2f08-01ad-489c-8daf-0f21e9d86208 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.450665 Dec 13 16:41:21.567026 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Dec 13 16:41:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:41:24.070678 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:24.072287 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-357b9116-3731-4a71-b2d0-008c2856a7cb None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Dec 13 16:41:24.073639 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:24 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:24.138204 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-6821f7b6-edd0-4d48-9542-1fc5402236c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:24.156076 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:41:24.156076 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: warnings.warn(msg) Dec 13 16:41:24.187366 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-6821f7b6-edd0-4d48-9542-1fc5402236c6 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107615 Dec 13 16:41:24.192738 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:24 2021] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:41:24.426394 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-8f5a6e8f-60a7-4dcb-9a45-49d244fb8728 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:24.428825 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:41:24.428825 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: warnings.warn(msg) Dec 13 16:41:24.480958 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-8f5a6e8f-60a7-4dcb-9a45-49d244fb8728 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284660 Dec 13 16:41:24.482293 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 13 16:41:24 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:41:26.954006 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-6821f7b6-edd0-4d48-9542-1fc5402236c6 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:26.955195 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-6821f7b6-edd0-4d48-9542-1fc5402236c6 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Dec 13 16:41:26.955677 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:27.071670 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-89c0a6f7-7693-4ade-bf26-8a2d62418f30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:27.094512 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:41:27.094512 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: warnings.warn(msg) Dec 13 16:41:27.115756 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-89c0a6f7-7693-4ade-bf26-8a2d62418f30 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152296 Dec 13 16:41:27.116562 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:41:27.129762 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-511341cb-05bc-4044-9eca-4e59ea3db936 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:27.131798 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:41:27.131798 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: warnings.warn(msg) Dec 13 16:41:27.165832 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-511341cb-05bc-4044-9eca-4e59ea3db936 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040308 Dec 13 16:41:27.166628 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 13 16:41:27 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:41:29.564473 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-89c0a6f7-7693-4ade-bf26-8a2d62418f30 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:29.565502 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-89c0a6f7-7693-4ade-bf26-8a2d62418f30 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Dec 13 16:41:29.565867 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:29.624974 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-54c2ed0c-e742-4a8f-bb4a-f1d1d9674be1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:29.645101 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-54c2ed0c-e742-4a8f-bb4a-f1d1d9674be1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072919 Dec 13 16:41:29.645845 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:41:29.660538 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-9d6e2cf1-5422-4e25-8b12-f6d1484431f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:29.685496 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-9d6e2cf1-5422-4e25-8b12-f6d1484431f2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030976 Dec 13 16:41:29.686280 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 13 16:41:29 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:41:32.103139 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-54c2ed0c-e742-4a8f-bb4a-f1d1d9674be1 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:32.104310 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-54c2ed0c-e742-4a8f-bb4a-f1d1d9674be1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Dec 13 16:41:32.104770 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:32.164634 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-1f108b05-c5d4-492a-acb8-d2aa7dab56a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:32.184162 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-1f108b05-c5d4-492a-acb8-d2aa7dab56a5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072835 Dec 13 16:41:32.184735 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:41:32.197184 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-08268333-f2cc-44ad-9d4b-e3be0f52f295 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:32.223296 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-08268333-f2cc-44ad-9d4b-e3be0f52f295 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029686 Dec 13 16:41:32.223925 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 13 16:41:32 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:41:34.702710 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-1f108b05-c5d4-492a-acb8-d2aa7dab56a5 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:34.703722 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-1f108b05-c5d4-492a-acb8-d2aa7dab56a5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 13 16:41:34.704104 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:34.766524 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-a992c6e2-6d20-40d1-9a1a-0aebe60da9eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "disk": 20}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:34.787280 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-a992c6e2-6d20-40d1-9a1a-0aebe60da9eb admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076780 Dec 13 16:41:34.788211 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:41:34.800090 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-e64a5572-364c-4181-853e-debf5c456129 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:34.832818 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-e64a5572-364c-4181-853e-debf5c456129 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036171 Dec 13 16:41:34.836633 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1335 bytes} [Mon Dec 13 16:41:34 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:41:37.240208 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-a992c6e2-6d20-40d1-9a1a-0aebe60da9eb admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:37.241323 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-a992c6e2-6d20-40d1-9a1a-0aebe60da9eb admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Dec 13 16:41:37.241710 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:37.312927 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-636df3e7-f2fb-4073-b49f-f11848876d2c admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:37.336259 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-636df3e7-f2fb-4073-b49f-f11848876d2c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087050 Dec 13 16:41:37.336776 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Dec 13 16:41:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:41:39.749335 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-a992c6e2-6d20-40d1-9a1a-0aebe60da9eb admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:39.750324 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-a992c6e2-6d20-40d1-9a1a-0aebe60da9eb admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Dec 13 16:41:39.751222 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:39.817808 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f4453678-7ada-4b09-a9ab-5bcd2f3eea3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "ram": 512, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:39.843302 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f4453678-7ada-4b09-a9ab-5bcd2f3eea3f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084785 Dec 13 16:41:39.844277 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:39 2021] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:41:39.859907 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-d84a6a8c-e688-4344-90c1-57f71b4c9336 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:39.888443 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-d84a6a8c-e688-4344-90c1-57f71b4c9336 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033211 Dec 13 16:41:39.889082 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 13 16:41:39 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:41:42.294719 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f4453678-7ada-4b09-a9ab-5bcd2f3eea3f admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:42.295723 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f4453678-7ada-4b09-a9ab-5bcd2f3eea3f admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Dec 13 16:41:42.296157 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:42.358067 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-77fd2209-bbb4-4d11-ad64-154c56d1fd8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:42.378183 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-77fd2209-bbb4-4d11-ad64-154c56d1fd8c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075389 Dec 13 16:41:42.378750 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:42 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:41:42.390887 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-89721b25-f4e6-4149-a27c-87fae9a6c96e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:42.416833 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-89721b25-f4e6-4149-a27c-87fae9a6c96e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028871 Dec 13 16:41:42.417442 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 13 16:41:42 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:41:44.914688 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-77fd2209-bbb4-4d11-ad64-154c56d1fd8c admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:44.915701 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-77fd2209-bbb4-4d11-ad64-154c56d1fd8c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Dec 13 16:41:44.916291 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:44.977215 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f1aac251-eacd-404d-b98d-0be5d00cce57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "disk": 40}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:44.997460 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f1aac251-eacd-404d-b98d-0be5d00cce57 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074656 Dec 13 16:41:44.998029 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:44 2021] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:41:45.011024 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-b5064535-0893-4afe-a2f9-b4ae9ca432c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:45.035754 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-b5064535-0893-4afe-a2f9-b4ae9ca432c5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028569 Dec 13 16:41:45.036352 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 13 16:41:45 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:41:47.447747 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f1aac251-eacd-404d-b98d-0be5d00cce57 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:47.448795 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f1aac251-eacd-404d-b98d-0be5d00cce57 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Dec 13 16:41:47.449205 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:47.518816 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-948fefd3-0471-45a0-ac13-e1383eb711cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "ram": 8192, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:47.542170 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-948fefd3-0471-45a0-ac13-e1383eb711cd admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086281 Dec 13 16:41:47.542724 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:47 2021] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:41:47.555346 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-fd431609-24d4-47ee-9e2e-0c93bc3f809f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:47.580190 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-fd431609-24d4-47ee-9e2e-0c93bc3f809f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028356 Dec 13 16:41:47.580723 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 13 16:41:47 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:41:50.077225 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-948fefd3-0471-45a0-ac13-e1383eb711cd admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:41:50.078244 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-948fefd3-0471-45a0-ac13-e1383eb711cd admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Dec 13 16:41:50.078661 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:41:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:41:50.144151 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-6b093909-b6bc-46dc-ad01-f9beb5e34831 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "vcpus": 8}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:50.165631 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-6b093909-b6bc-46dc-ad01-f9beb5e34831 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080294 Dec 13 16:41:50.166216 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1282 bytes} [Mon Dec 13 16:41:50 2021] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:41:50.179986 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-c17a10f3-6494-475f-9670-7a2476e315b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:41:50.208995 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-c17a10f3-6494-475f-9670-7a2476e315b7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034061 Dec 13 16:41:50.209902 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1332 bytes} [Mon Dec 13 16:41:50 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:42:11.355749 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-6b093909-b6bc-46dc-ad01-f9beb5e34831 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:11.356856 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-6b093909-b6bc-46dc-ad01-f9beb5e34831 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Dec 13 16:42:11.357258 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:42:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:11.427834 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-96baaa3f-fa22-4340-8241-ed9fb90b5104 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:11.453100 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-96baaa3f-fa22-4340-8241-ed9fb90b5104 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.089097 Dec 13 16:42:11.453638 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Dec 13 16:42:11 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:42:13.055141 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-6b093909-b6bc-46dc-ad01-f9beb5e34831 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:13.056487 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-6b093909-b6bc-46dc-ad01-f9beb5e34831 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Dec 13 16:42:13.056943 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:42:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:13.259363 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-991ba018-d728-4ea4-aa76-516c86155855 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:13.265673 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.wsgi [None req-991ba018-d728-4ea4-aa76-516c86155855 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 13 16:42:13.266238 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-991ba018-d728-4ea4-aa76-516c86155855 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:42:13.267037 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-991ba018-d728-4ea4-aa76-516c86155855 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066208 Dec 13 16:42:13.267552 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Dec 13 16:42:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:13.277663 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-2afdedf5-38b6-43f9-9c6c-ff97bbc74ceb admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:13.298343 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-2afdedf5-38b6-43f9-9c6c-ff97bbc74ceb admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024321 Dec 13 16:42:13.298876 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 13 16:42:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:42:13.309251 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-9b811593-286c-42f9-bcfb-1db57caf3c10 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:13.329943 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-9b811593-286c-42f9-bcfb-1db57caf3c10 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024379 Dec 13 16:42:13.330516 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 13 16:42:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:42:13.340851 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-c606dac7-af79-487b-99c8-4ef6dd632daf admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:13.346847 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.wsgi [None req-c606dac7-af79-487b-99c8-4ef6dd632daf admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 13 16:42:13.347419 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-c606dac7-af79-487b-99c8-4ef6dd632daf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:42:13.348208 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-c606dac7-af79-487b-99c8-4ef6dd632daf admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011078 Dec 13 16:42:13.348751 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Dec 13 16:42:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:14.872627 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-9b811593-286c-42f9-bcfb-1db57caf3c10 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:14.873676 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-9b811593-286c-42f9-bcfb-1db57caf3c10 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Dec 13 16:42:14.874075 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:42:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:15.079433 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-9b3cc6fe-20ae-4d9e-86fb-259b5b44f0bf admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:15.085559 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.wsgi [None req-9b3cc6fe-20ae-4d9e-86fb-259b5b44f0bf admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 13 16:42:15.086117 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-9b3cc6fe-20ae-4d9e-86fb-259b5b44f0bf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:42:15.086898 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-9b3cc6fe-20ae-4d9e-86fb-259b5b44f0bf admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075813 Dec 13 16:42:15.087403 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Dec 13 16:42:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:15.097473 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-ad7aea0e-fac0-4772-9ce2-743c47ac9974 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:15.111466 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-ad7aea0e-fac0-4772-9ce2-743c47ac9974 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017532 Dec 13 16:42:15.111989 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 13 16:42:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:42:15.122024 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-668548b2-8b20-4513-a5b8-5fd20319ee45 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:15.135931 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-668548b2-8b20-4513-a5b8-5fd20319ee45 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017412 Dec 13 16:42:15.136525 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 13 16:42:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:42:15.146695 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-f5b0c06e-4132-4b52-bc65-8c97a8a2c9e3 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:15.152175 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.wsgi [None req-f5b0c06e-4132-4b52-bc65-8c97a8a2c9e3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 13 16:42:15.152820 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-f5b0c06e-4132-4b52-bc65-8c97a8a2c9e3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:42:15.153679 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-f5b0c06e-4132-4b52-bc65-8c97a8a2c9e3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010418 Dec 13 16:42:15.154168 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Dec 13 16:42:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:16.644182 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-668548b2-8b20-4513-a5b8-5fd20319ee45 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:16.645260 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-668548b2-8b20-4513-a5b8-5fd20319ee45 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Dec 13 16:42:16.645663 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:42:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:16.854848 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-e9c56138-03c1-4e54-9716-3a23d79e27ba admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:16.860602 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.wsgi [None req-e9c56138-03c1-4e54-9716-3a23d79e27ba admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 13 16:42:16.861140 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-e9c56138-03c1-4e54-9716-3a23d79e27ba admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:42:16.861954 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-e9c56138-03c1-4e54-9716-3a23d79e27ba admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065942 Dec 13 16:42:16.862456 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 13 16:42:16 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:16.873223 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-242c1000-ff9d-4c2a-80a7-8dcc23a1260d admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:16.887917 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-242c1000-ff9d-4c2a-80a7-8dcc23a1260d admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018596 Dec 13 16:42:16.888809 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 13 16:42:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:42:16.899434 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:16.913559 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018102 Dec 13 16:42:16.914095 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Dec 13 16:42:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:42:16.926761 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-a9b3b8df-ebab-49c6-94b0-0bc5009e4bde admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:16.934550 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.wsgi [None req-a9b3b8df-ebab-49c6-94b0-0bc5009e4bde admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 13 16:42:16.935105 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-a9b3b8df-ebab-49c6-94b0-0bc5009e4bde admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:42:16.935880 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-a9b3b8df-ebab-49c6-94b0-0bc5009e4bde admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014989 Dec 13 16:42:16.936379 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 13 16:42:16 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:18.449541 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:18.450568 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Dec 13 16:42:18.450957 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:42:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:18.669413 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-1b7e7fcb-655e-4705-8b51-5c253f64bd5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:42:18.691834 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-1b7e7fcb-655e-4705-8b51-5c253f64bd5e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.098572 Dec 13 16:42:18.692373 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Dec 13 16:42:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:42:20.162588 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:20.163898 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Dec 13 16:42:20.164368 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:42:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:20.367466 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-3c803cda-9b44-4836-be31-b25cea61fff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:42:20.387155 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-3c803cda-9b44-4836-be31-b25cea61fff8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077832 Dec 13 16:42:20.387824 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Dec 13 16:42:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:42:21.949250 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:21.950336 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003404 Dec 13 16:42:21.950703 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:42:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:22.195153 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-b0a2d58f-d80b-4b8c-a3f8-b6fb54f8df6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:42:22.215150 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-b0a2d58f-d80b-4b8c-a3f8-b6fb54f8df6f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.092140 Dec 13 16:42:22.215759 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Dec 13 16:42:22 2021] POST /compute/v2.1/flavors => generated 407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:42:23.764919 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:23.765922 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Dec 13 16:42:23.766314 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:42:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:23.958495 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-cdf695ba-039c-4d9f-9019-132a973585c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:42:23.982667 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-cdf695ba-039c-4d9f-9019-132a973585c8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.079257 Dec 13 16:42:23.983186 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Dec 13 16:42:23 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:42:25.483126 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:25.484157 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Dec 13 16:42:25.484550 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:42:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:42:25.710182 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-8f294f2b-b59a-4788-867e-8dc98d2249d7 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:42:25.729200 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-8f294f2b-b59a-4788-867e-8dc98d2249d7 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.093626 Dec 13 16:42:25.729739 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Mon Dec 13 16:42:25 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:43:13.761269 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:43:13.762554 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-7738dc0b-0552-4f6a-850f-3bac653d1568 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Dec 13 16:43:13.762947 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 930 bytes} [Mon Dec 13 16:43:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:43:13.826783 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-58a8ff8f-0656-4ee8-81be-e4ba29812679 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:43:13.846092 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-58a8ff8f-0656-4ee8-81be-e4ba29812679 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076471 Dec 13 16:43:13.846643 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1291 bytes} [Mon Dec 13 16:43:13 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:43:13.869065 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-5fb60c3e-9fc7-4178-ab3d-fbcc24859327 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:43:13.881728 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-5fb60c3e-9fc7-4178-ab3d-fbcc24859327 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016308 Dec 13 16:43:13.882311 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1282 bytes} [Mon Dec 13 16:43:13 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:43:13.896405 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-02fa049b-011a-451d-9f2b-e329327e1d40 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:43:13.907370 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-02fa049b-011a-451d-9f2b-e329327e1d40 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015889 Dec 13 16:43:13.907930 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1285 bytes} [Mon Dec 13 16:43:13 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:43:13.920039 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-98c36e71-a2f9-427d-8eed-b91dbdf6def2 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:43:13.928399 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-98c36e71-a2f9-427d-8eed-b91dbdf6def2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012076 Dec 13 16:43:13.928966 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1285 bytes} [Mon Dec 13 16:43:13 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:43:13.943125 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:43:13.954982 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017117 Dec 13 16:43:13.955788 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1282 bytes} [Mon Dec 13 16:43:13 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:44:43.881263 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-e071e2e5-66ca-4a4a-aaa4-e60e95d9fff2 tempest-verify_tempest_config-1675893029 tempest-verify_tempest_config-1675893029-project] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:44:43.883171 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-e071e2e5-66ca-4a4a-aaa4-e60e95d9fff2 tempest-verify_tempest_config-1675893029 tempest-verify_tempest_config-1675893029-project] 10.222.0.62 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.118201 Dec 13 16:44:43.883711 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 34/69] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Dec 13 16:44:43 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:46:12.924873 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:46:12.925820 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Dec 13 16:46:12.926226 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 36/70] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:46:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:46:13.199673 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-45d391b6-7cd0-4031-91eb-16e3051d349f admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:46:13.200899 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:46:13.200899 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: warnings.warn(msg) Dec 13 16:46:13.202466 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-45d391b6-7cd0-4031-91eb-16e3051d349f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:46:13.202921 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-45d391b6-7cd0-4031-91eb-16e3051d349f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:46:13.203702 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-45d391b6-7cd0-4031-91eb-16e3051d349f admin admin] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:46:13.204115 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-45d391b6-7cd0-4031-91eb-16e3051d349f admin admin] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:46:13.238709 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-45d391b6-7cd0-4031-91eb-16e3051d349f admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166119 Dec 13 16:46:13.239195 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 35/71] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 13 16:46:13 2021] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:46:14.777953 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:46:14.779271 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Dec 13 16:46:14.779823 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 37/72] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:46:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:46:14.978339 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-0d571a0e-a250-42a2-b231-a5c0048ffade admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:46:14.979563 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:46:14.979563 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: warnings.warn(msg) Dec 13 16:46:14.981147 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-0d571a0e-a250-42a2-b231-a5c0048ffade admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:46:14.981682 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-0d571a0e-a250-42a2-b231-a5c0048ffade admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:46:14.982540 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-0d571a0e-a250-42a2-b231-a5c0048ffade admin admin] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:46:14.982961 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-0d571a0e-a250-42a2-b231-a5c0048ffade admin admin] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:46:15.008119 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-0d571a0e-a250-42a2-b231-a5c0048ffade admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087569 Dec 13 16:46:15.008716 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 36/73] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 13 16:46:14 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:46:27.169880 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:46:27.170884 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Dec 13 16:46:27.171283 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 38/74] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:46:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:46:27.377369 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-29cdce91-c87a-42bd-a7d4-b00e155a4003 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:46:27.378568 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:46:27.378568 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: warnings.warn(msg) Dec 13 16:46:27.380126 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-29cdce91-c87a-42bd-a7d4-b00e155a4003 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:46:27.380564 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-29cdce91-c87a-42bd-a7d4-b00e155a4003 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:46:27.381376 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-29cdce91-c87a-42bd-a7d4-b00e155a4003 admin admin] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:46:27.381798 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-29cdce91-c87a-42bd-a7d4-b00e155a4003 admin admin] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:46:27.403964 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-29cdce91-c87a-42bd-a7d4-b00e155a4003 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088459 Dec 13 16:46:27.404554 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 37/75] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 13 16:46:27 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:46:28.975965 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: DEBUG nova.api.openstack.wsgi [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] Calling method '>' {{(pid=108698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:46:28.977548 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: INFO nova.api.openstack.requestlog [None req-f47669d2-5474-4aca-91f6-e45522b769c3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002409 Dec 13 16:46:28.978461 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: [pid: 108698|app: 0|req: 39/76] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Dec 13 16:46:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:46:29.196335 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG nova.api.openstack.wsgi [None req-afb39404-a006-4425-9844-b341ba655104 admin admin] Calling method '>' {{(pid=108699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:46:29.197760 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:46:29.197760 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: warnings.warn(msg) Dec 13 16:46:29.199864 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-afb39404-a006-4425-9844-b341ba655104 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:46:29.200310 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-afb39404-a006-4425-9844-b341ba655104 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:46:29.201140 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-afb39404-a006-4425-9844-b341ba655104 admin admin] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:46:29.201568 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: DEBUG oslo_concurrency.lockutils [None req-afb39404-a006-4425-9844-b341ba655104 admin admin] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:46:29.227849 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: INFO nova.api.openstack.requestlog [None req-afb39404-a006-4425-9844-b341ba655104 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.104076 Dec 13 16:46:29.228743 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: [pid: 108699|app: 0|req: 38/77] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Dec 13 16:46:29 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:47:26.841399 dv-cinder-821602-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 13 16:47:26.842179 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: Mon Dec 13 16:47:26 2021 - graceful shutdown triggered... Dec 13 16:47:26.842633 dv-cinder-821602-2-iscsi devstack@n-api.service[108698]: Gracefully killing worker 1 (pid: 108698)... Dec 13 16:47:26.843000 dv-cinder-821602-2-iscsi devstack@n-api.service[108699]: Gracefully killing worker 2 (pid: 108699)... Dec 13 16:47:27.842732 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: worker 1 buried after 1 seconds Dec 13 16:47:27.842732 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: worker 2 buried after 1 seconds Dec 13 16:47:27.842732 dv-cinder-821602-2-iscsi devstack@n-api.service[108697]: goodbye to uWSGI. Dec 13 16:47:27.844427 dv-cinder-821602-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 13 16:47:27.845029 dv-cinder-821602-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 13 16:47:27.847863 dv-cinder-821602-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 13 16:47:27.867049 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 13 16:47:27 2021] *** Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: nodename: dv-cinder-821602-2-iscsi Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: machine: x86_64 Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: clock source: unix Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: pcre jit disabled Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: detected number of CPU cores: 4 Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: current working directory: / Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: detected binary path: /usr/bin/uwsgi-core Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: your processes number limit is 47680 Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: your memory page size is 4096 bytes Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: detected max file descriptor number: 2048 Dec 13 16:47:27.869240 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: lock engine: pthread robust mutexes Dec 13 16:47:27.870275 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: thunder lock: enabled Dec 13 16:47:27.870275 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 13 16:47:27.870275 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 13 16:47:27.918201 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: Python main interpreter initialized at 0x55d8971e99c0 Dec 13 16:47:27.918201 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: python threads support enabled Dec 13 16:47:27.918201 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: your server socket listen backlog is limited to 100 connections Dec 13 16:47:27.918201 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: your mercy for graceful operations on workers is 90 seconds Dec 13 16:47:27.918640 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: mapped 403077 bytes (393 KB) for 2 cores Dec 13 16:47:27.918640 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: *** Operational MODE: preforking *** Dec 13 16:47:27.918955 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: *** uWSGI is running in multiple interpreter mode *** Dec 13 16:47:27.918955 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: spawned uWSGI master process (pid: 122862) Dec 13 16:47:27.919205 dv-cinder-821602-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 13 16:47:27.920360 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: spawned uWSGI worker 1 (pid: 122885, cores: 1) Dec 13 16:47:27.920360 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: spawned uWSGI worker 2 (pid: 122886, cores: 1) Dec 13 16:47:27.920360 dv-cinder-821602-2-iscsi devstack@n-api.service[122862]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 13 16:47:29.880604 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:47:29.880604 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: from cryptography.utils import int_from_bytes Dec 13 16:47:29.881335 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:47:29.881335 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: from cryptography.utils import int_from_bytes Dec 13 16:47:29.940140 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:47:29.940140 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: from cryptography.utils import int_from_bytes Dec 13 16:47:29.940858 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:47:29.940858 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: from cryptography.utils import int_from_bytes Dec 13 16:47:32.319712 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 16:47:32.321089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 16:47:32.321089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 16:47:32.321089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 16:47:32.321089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 16:47:32.321590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.321778 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.322542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.322746 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.322995 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.323308 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.323627 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.323945 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.324274 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.324548 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.324886 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.325211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-2-iscsi {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.325530 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.325834 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.326126 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.326458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.326758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.327075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.327377 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.327876 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.328915 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.328915 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.329389 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.329646 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.329979 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.330267 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.330612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.330904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.331233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.331525 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.331928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-2-iscsi {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.332247 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.332724 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.332976 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.333471 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.333894 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.334203 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.334691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.335171 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.335632 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.336105 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.336592 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.337068 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.337532 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.337996 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.338479 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.338943 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.339417 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.339871 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.340335 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.340780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.341247 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.341713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.342193 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.342679 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.342942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.343373 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.343512 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.343830 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.344144 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.344459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.344804 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.345119 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.345434 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.345740 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.346051 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.346358 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.346678 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.346998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.347320 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.347634 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.347958 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.348424 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.348752 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.349076 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.349407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.349726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.350034 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.350356 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.350675 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.350983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.351290 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.351595 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.351913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.352246 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.352553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.352832 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.353131 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.353449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.353749 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.354057 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.354364 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.354671 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.354972 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.355274 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.355582 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.355884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.356187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.356491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.356820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.357127 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.357430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.357734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.358054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.358374 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.358676 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.358979 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.359284 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.359602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.359904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.360208 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.360511 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.360858 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.361161 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.361464 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.361778 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.362082 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.362386 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.362702 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.362998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.363302 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.363615 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.363974 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.364247 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.364549 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.364873 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.365176 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.365479 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.365779 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.366260 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.366569 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.366865 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.367181 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.367489 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.367793 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.368102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.368421 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.368791 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.369146 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.369501 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.369769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.370129 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.370455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.370770 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.371054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.371372 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.371689 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.372002 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.372312 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.372649 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.372971 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.373322 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.373755 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.374118 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.374854 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.375177 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.375488 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.375803 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.376131 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.376423 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.376803 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.377126 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.377465 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.377780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.378084 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.378553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.379037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.379366 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.379860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.380452 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.380452 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.380776 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.381072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.381428 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.381719 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.382055 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.382345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.382650 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.382949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.383262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.383565 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.383881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.384205 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.384512 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.384874 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.385176 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.385487 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.385795 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.386101 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.386437 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.386731 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.387024 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.387347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.387657 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.387949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.388272 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.388678 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.388903 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.389205 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.389515 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.389825 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.390135 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.390456 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.390766 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.391075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.391407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.391733 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.392036 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.392358 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.392705 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.393021 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.393343 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.393633 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.393935 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.394236 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.394540 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.394847 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.395447 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.396010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.396010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.396440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.396696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.396845 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 16:47:32.396845 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 16:47:32.397601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.397601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.397912 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 16:47:32.398102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.398253 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 16:47:32.398400 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.398546 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 16:47:32.398700 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.398848 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.398989 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.399137 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.399277 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.399473 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.399642 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.399797 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.399944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.400085 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.400233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.400388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.400537 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.400735 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.400879 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.401027 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.401173 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.401325 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.401474 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.401635 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.401778 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.401926 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.402077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.402279 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821602-2-iscsi {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.402441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.402584 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.402730 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.402872 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.403018 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.403174 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.403315 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.403315 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.403606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.403753 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.403908 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.404049 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.404189 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.404335 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.404477 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.404644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.404644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.404935 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.405275 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.405444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.405586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.405736 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.405885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.406035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.406213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.406360 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.406501 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.406653 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.406795 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.406934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.407082 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.407233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.407384 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.407549 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.407690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.407838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.409043 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.409206 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.409359 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.409359 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.409643 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821602-2-iscsi {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.409793 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.409935 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.410074 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.410231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.410428 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.410578 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.410848 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.411061 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.411698 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.411863 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.412005 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.412146 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.412296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.412455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.412657 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.412817 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.412981 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.413123 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.413263 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.413414 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.413555 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.413713 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.413855 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.413996 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.414137 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.414284 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.414468 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.414622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.414763 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.414920 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.415061 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.415201 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.415340 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.415490 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.415632 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.415779 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.415929 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.416077 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.416237 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.416385 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.416526 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.416699 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.416852 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.416994 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.417143 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.417284 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.417423 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.417572 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.417724 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.417882 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.418040 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.418182 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.418325 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.418482 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.418633 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.418787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.418930 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.419071 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.419209 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.419357 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.419498 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.419653 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.419802 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.419942 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.420081 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.420221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.420372 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.420526 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.420718 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.420871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.421036 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.421190 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.421344 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.421493 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.421641 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.421789 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.421936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.422082 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.422239 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.422406 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.422589 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.422739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.422886 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.423040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.423268 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.423431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.423578 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.423725 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.423882 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.424038 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.424200 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.424367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.424515 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.425141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.425298 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.425447 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.425607 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.425767 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.425923 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.426071 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.426225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.426436 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.426664 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.426885 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.427058 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.427298 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.427467 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.427637 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.427800 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.427957 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.428104 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.428259 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.428406 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.428582 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.428750 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.428906 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.429061 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.429220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.429366 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.429527 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.429675 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.429832 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.429832 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.429832 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.430252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.430252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.430538 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.430685 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.430838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.430993 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.431165 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.431165 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.431454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.431611 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.431758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.431914 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.432069 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.432217 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.432370 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.432525 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.432728 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.432891 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.433050 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.433207 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.433355 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.433500 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.433662 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.433830 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.433986 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.434133 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.434290 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.434436 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.434596 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.434744 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.434899 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.435061 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.435217 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.435365 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.435511 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.435666 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.435822 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.435822 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.436128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.436128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.436416 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.436563 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.436748 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.436909 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.437085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.437251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.437410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.437578 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.437726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.437894 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.438041 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.438196 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.438373 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.438527 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.438681 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.438829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.439002 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.439170 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.439334 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.439510 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.439667 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.439667 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.439963 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.440121 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.440281 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.440436 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.440624 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.440790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.440945 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.441091 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.441263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.441418 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.441566 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.441714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.441861 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.442618 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.442802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.442953 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.443101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.443255 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.443402 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.443558 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.443726 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.443874 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.444020 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.444167 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.444322 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:47:32.444480 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.444480 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.444811 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.444959 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.445106 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.445260 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.445417 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.445566 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.445730 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.445886 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.446041 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.446200 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.446200 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.446481 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.446637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.446792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.446948 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.447110 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.447257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.447404 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.447559 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.447716 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.447874 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.448102 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.448252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.448398 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.448553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.448735 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.448900 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.449057 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.449203 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.449203 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.449481 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.449637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.449792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.449940 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.450088 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.450241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.450388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.450534 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.450689 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.450844 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.450844 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.451139 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.451287 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.451433 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.451598 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.451754 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.451902 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.452055 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.452203 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.452350 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.452510 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.452683 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.452843 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.453001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.453150 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.453306 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.453454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.453619 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.453767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.453767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.454062 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.454219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.454367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.454521 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.454668 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.454820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.454820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.455117 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.455266 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.455420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.455586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.455586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.455881 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.456037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.456186 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.456333 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.456479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.456668 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.456838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.456988 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.457147 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.457295 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.457461 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.457681 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.458156 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.458316 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.458547 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.458705 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.458705 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.458996 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.459160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.459317 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.459472 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.459667 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.459825 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.459984 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.460145 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.460293 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.460440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.460440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.460757 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.460918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.461067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.461215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.461215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.461503 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.461503 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.461799 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.461962 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.462111 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.462258 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.462413 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.462413 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.462715 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.462863 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.463010 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.463156 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.463304 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.463459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.463459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.463768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.463928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.464076 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.464241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.464447 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.464622 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.464793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.464954 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.465118 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.465266 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.465442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.465592 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.465748 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.465913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.466062 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.466208 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.466369 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.466517 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.466665 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.466813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.466967 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.467115 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.467277 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.467425 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.467590 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.467739 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.467898 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.468059 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.468208 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.468355 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.468509 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.468720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.468873 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.469036 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.469194 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.469348 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.469495 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.469650 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.469798 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.469967 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.470123 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.470270 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.470426 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.470580 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.470736 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.470900 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.471058 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.471211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.471359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.471504 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.471660 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.471814 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.471974 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.472123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.472271 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.472425 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.472598 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.472753 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.472900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.473046 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.473380 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.473997 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.474178 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.474330 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.474497 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.474645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.474810 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.474965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.475122 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.475270 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.475417 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.475417 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.475710 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.475871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.476019 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.476019 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.476314 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.476479 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.476686 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.476859 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.477008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.477154 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.477308 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.477455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.477612 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.477849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.478011 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.478011 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.478298 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.478444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.478601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.478758 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.478912 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.479059 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.479215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.479363 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.479518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.479665 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.479818 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.480040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.480197 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.480345 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.480507 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.480701 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.480850 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.481003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.481003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.481281 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.481442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.481590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.481590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.481884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.482030 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.482184 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.482339 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.482510 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.482665 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.482820 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.482974 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.483130 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.483277 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.483433 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.483588 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.483735 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.483880 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.484040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.484194 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.484346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.484504 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.484700 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.484860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.485021 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.485250 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.485400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.485553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.485702 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.485848 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.486003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.486157 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.486303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.486449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.486611 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.486611 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.486909 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.487066 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.487219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.487366 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.487518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.487518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.487830 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.487984 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.488131 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.488285 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.488437 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.488633 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.488815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.489050 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.489626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.489800 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.489952 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.490115 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.490264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.490419 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.490567 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.490713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.490943 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.491113 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.491261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.491414 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.491568 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.491714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.491870 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.492019 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.492019 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.492306 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.492306 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.492629 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.492802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.492958 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.493120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.493274 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.493421 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.493575 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.493734 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.493881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.493881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.494176 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.494322 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.494474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.494634 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.494792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.494912 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495189 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495276 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495558 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495707 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495803 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495899 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.495984 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496074 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496159 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496242 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496333 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496432 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496524 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496650 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496738 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.496917 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497033 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497129 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497304 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497387 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497479 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497564 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497656 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497656 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497817 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497906 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.497998 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498082 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498171 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498345 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498427 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498542 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498658 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498757 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498861 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.498941 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.499047 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.499142 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.499249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.499333 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.499763 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.499953 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500057 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500166 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500270 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500446 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500529 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500661 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500750 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.500991 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501087 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501181 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501181 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501334 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501416 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501498 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501587 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501858 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.501942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502230 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502317 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502408 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502494 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502678 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502827 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502915 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.502998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503081 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503163 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503253 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503346 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503534 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503625 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503717 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.503814 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.504395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.504662 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.504770 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.504845 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.504916 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.505000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.505080 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.505172 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.505302 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.505446 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.505621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.505933 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.506070 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.506207 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.506318 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.506544 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.506685 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.506886 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.507037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.507141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.507235 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.507488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.507639 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.507742 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.507829 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.508088 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.508248 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.508370 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.508471 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.508734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.508884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.509052 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.509196 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.509325 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.509431 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.509650 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.509790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.509903 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.510001 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.510276 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.510427 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.510562 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.510782 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.510898 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.510993 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.511193 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.511333 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.511501 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.511642 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.511810 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.511936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.512136 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.512267 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.512434 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.512540 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.512839 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.512936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.513148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.513244 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.513451 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.513557 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.513758 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.513854 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.514139 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.514429 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.514512 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.514596 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.514689 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.514912 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.515026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.515243 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.515362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.515554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.515692 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.515888 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.515992 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.516274 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.516685 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.516945 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.517041 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.517262 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.517365 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.517569 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.517679 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.517873 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.517976 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.518175 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.518395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.518495 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.518581 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.518775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.519092 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.519263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.519354 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.519555 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.519651 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.519866 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.520096 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.520194 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.520531 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.520937 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.521017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.521103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.521196 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.521284 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.521684 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.521844 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.521992 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.522146 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.522301 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.522463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.522611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.522757 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.522914 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.523068 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.523216 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.523447 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.523597 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.523743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.523896 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.524044 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.524197 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.524547 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.524741 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.524993 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.525146 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.525305 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.525305 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.525601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.525757 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.525904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.526050 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.526203 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.526364 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.526364 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.526662 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.526811 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.526964 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.527132 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.527293 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.527441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.527588 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.527733 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.527878 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.528024 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.528179 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.528333 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.528480 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.528644 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.528796 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.528981 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.529313 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.529469 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.529616 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.529772 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.529919 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.530079 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.530233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.530387 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.530534 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.530679 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.530824 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.530984 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.531140 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.531334 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.531486 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.531640 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.531788 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.531946 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.532100 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.532255 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.532410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.532410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.532747 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.532897 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.533043 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.533195 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.533352 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.533506 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.533661 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.533817 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.533978 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.534132 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.534279 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.534442 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.534740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.534903 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.535162 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.535317 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.535464 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.535622 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.535838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.536248 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.536753 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.536904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.537054 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.537213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.537380 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.537528 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.537676 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.537823 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.537987 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.538166 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.538315 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.538470 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.538648 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.538648 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.538934 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.539091 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.539280 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.539561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.539724 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.539880 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.540035 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.540198 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.540357 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.540504 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.540696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.540844 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.540990 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.541153 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.541153 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.541432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.541578 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.541723 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.541878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542180 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.542338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.543502 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.543502 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.543502 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.543502 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.544080 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.544080 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.544372 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.544884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.545059 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.545059 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.545502 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.545658 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.545820 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.545975 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.546174 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.546330 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.546452 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.546573 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.546573 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.546805 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.546922 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.547049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.547163 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.547403 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.547568 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.547753 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.547942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.548144 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.548413 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.548763 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.548963 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.549123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.549292 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.549442 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.549828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.550001 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.550151 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.550306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.550454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.550600 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.550600 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.550895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.551084 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.551239 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.551415 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.551811 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.552357 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.552357 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.552689 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.552849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.553056 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.553210 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.553385 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.553547 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.553695 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.553957 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.554150 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.554309 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.554473 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.554641 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.554829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.555244 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.555560 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.555726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.555975 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.556135 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.556291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.556458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.556689 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.556860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.556976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.557086 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.557221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.557449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.557618 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.557913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.558166 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.558377 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.558582 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.559033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.559033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.559356 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.559505 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.560087 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.560253 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.560368 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.560491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.560491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.560889 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.561049 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.561199 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.561408 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.561587 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.561737 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.561894 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.562052 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.562052 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.562350 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.562507 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.562664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.562812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.562967 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.563114 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.563272 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.563459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.563632 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.563780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.563928 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.564075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.564075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.564366 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.564521 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.564717 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.565336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.565520 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.565832 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.565999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.566170 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.566328 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.566479 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.566626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.566941 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.567174 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.567916 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.568080 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.568237 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.568237 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.568550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.568731 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.568891 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.569054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.569211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.569374 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.569525 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.569680 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.569895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.570241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.570437 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.570607 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.570766 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.570915 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.570915 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571546 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571707 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 16:47:32.571862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.571862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.572871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.572871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.572871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.573312 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.573466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.573704 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.574034 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.574344 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.574670 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.575035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.575408 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.575677 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.575992 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.576334 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.576777 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.577155 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.579775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.579775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.579775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.579775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.579775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.579775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.579775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.579775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.581231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.581231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.581231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.581231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.581856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.581856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.582153 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.582309 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.582497 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.583639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.583639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.583639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.584150 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.584301 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.584457 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.584802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.585182 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.585546 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.585857 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.586175 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.586488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.586812 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.587211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.588753 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.589208 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.589566 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.589843 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.590200 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.592608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.592608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.592608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.592608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.592608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.592608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.592608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.593374 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.593374 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.593682 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.594004 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.594326 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.594647 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.594968 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.595289 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.595606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.595924 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.596351 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_db.sqlalchemy.engines [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:47:32.596614 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.596614 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.596948 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.597194 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.597524 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.597870 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.598233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.598559 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.598878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.599196 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.599559 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.599888 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.600607 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.600607 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.601125 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.601125 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.601427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.601710 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.602025 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.602339 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.602653 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.602965 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.603279 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.603594 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.604001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.604250 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.604591 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.604907 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.605220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.605806 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.606143 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.606390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.606703 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.607031 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.607353 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.607670 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.607987 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.608356 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.608784 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.608973 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.609240 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.609550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.609856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.610177 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.610488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.610792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.611161 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.611407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.611937 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.612283 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.612639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.612945 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.613268 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.613583 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.614029 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.614597 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.615005 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.615315 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.615635 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.615952 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.616261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.616595 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.616932 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.617205 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.617508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.617823 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.618132 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.618522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.618911 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.619102 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.619352 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.619663 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.619968 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.620272 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.620622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.620900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.621303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.621510 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.621818 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.622119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.622431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.622738 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.623047 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.623351 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.623676 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.623982 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.624287 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.624965 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.625279 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.625600 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.625913 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.626225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.626574 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.627028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.627470 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.627863 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.628249 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.628527 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.628910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.629260 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.629545 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.632135 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.633615 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.635218 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.637588 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.637994 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.638426 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.638654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.639014 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.639434 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.639645 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.639995 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.640324 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.640743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.641082 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.641505 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.641713 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.642069 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.642427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.642657 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.643202 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.643505 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.643835 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.644235 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.644482 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.644806 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.645454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.646082 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.646509 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.646876 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.647181 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.647531 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.647827 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.648145 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.648590 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.648994 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.649551 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.649803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.650137 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.650468 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.650778 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.651190 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.651512 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.651804 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.652148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.652479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.652828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.653154 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.653479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.653792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.654112 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.654435 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.654755 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.655081 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.655392 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.655726 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.656039 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.656351 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.656692 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.657012 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.657324 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.657626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.657958 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.658286 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.658590 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.658919 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.659234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.659554 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.661119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.661119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.661119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.661119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.661732 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.661732 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.662160 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.662311 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.662662 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.662940 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.663264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.663592 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.663917 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.665141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.665141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.665141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.665643 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.665643 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.665949 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.666452 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:47:32.666452 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 16:47:32.674199 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.context [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31ce76d4-9fe4-4b8d-a79f-c827d49740a3(cell1) {{(pid=122885) load_cells /opt/stack/nova/nova/context.py:464}} Dec 13 16:47:32.678715 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:47:32.680329 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:47:32.681128 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:47:32.683061 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:47:32.689648 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_db.sqlalchemy.engines [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:47:32.697543 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_db.sqlalchemy.engines [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:47:32.698834 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_db.sqlalchemy.engines [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:47:32.761792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.context [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31ce76d4-9fe4-4b8d-a79f-c827d49740a3(cell1) {{(pid=122886) load_cells /opt/stack/nova/nova/context.py:464}} Dec 13 16:47:32.767579 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:47:32.769737 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:47:32.770772 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:47:32.772933 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:47:32.784155 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_db.sqlalchemy.engines [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:47:32.784398 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_db.sqlalchemy.engines [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:47:32.868074 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_db.sqlalchemy.engines [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:47:32.950953 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_db.sqlalchemy.engines [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:47:33.182795 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: WARNING keystonemiddleware.auth_token [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 16:47:33.189884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: WARNING keystonemiddleware.auth_token [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 16:47:33.272416 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: WARNING keystonemiddleware.auth_token [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 16:47:33.279291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: WARNING keystonemiddleware.auth_token [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 16:47:33.531231 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: WARNING keystonemiddleware.auth_token [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 16:47:33.536973 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: WARNING keystonemiddleware.auth_token [None req-aec5104e-153b-4986-a4b7-76b2f8becba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 16:47:33.542331 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8971e99c0 pid: 122885 (default app) Dec 13 16:47:33.621361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: WARNING keystonemiddleware.auth_token [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 13 16:47:33.626949 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: WARNING keystonemiddleware.auth_token [None req-bb298864-664a-425b-aeb4-910f458ee71d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 13 16:47:33.632488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8971e99c0 pid: 122886 (default app) Dec 13 16:48:10.205602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d96a8543-228c-4c4e-80cc-ee4770feb67f tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] Action: 'create', calling method: .version_select at 0x7f2149f5fe50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1253927733", "metadata": {"Type": "work"}}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:10.480274 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-559600c2-5f79-41da-9f6e-113e5ab713a5 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Action: 'create', calling method: .version_select at 0x7f2149f12dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1169719467", "metadata": {"Type": "work"}}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:10.482086 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-559600c2-5f79-41da-9f6e-113e5ab713a5 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:48:10.483041 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-559600c2-5f79-41da-9f6e-113e5ab713a5 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.472605 Dec 13 16:48:10.484003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 13 16:48:09 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1475 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:48:10.500800 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-46872b21-a9ae-44ff-8fd7-2fa7b4ccd81f tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f2149f3a9d0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:10.904952 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-46872b21-a9ae-44ff-8fd7-2fa7b4ccd81f tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/1149ff46-ac88-49cd-9001-9b3ec3bab460" status: 200 len: 350 microversion: 2.1 time: 0.418804 Dec 13 16:48:10.906463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 2/2] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:10 2021] GET /compute/v2.1/os-volumes/1149ff46-ac88-49cd-9001-9b3ec3bab460 => generated 350 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:10.919725 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0bc21855-cb34-42fb-80dc-524cb7eee055 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Action: 'create', calling method: .version_select at 0x7f214a763790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-735813671", "metadata": {"Type": "work"}}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:10.923085 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0bc21855-cb34-42fb-80dc-524cb7eee055 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:48:10.929208 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0bc21855-cb34-42fb-80dc-524cb7eee055 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020543 Dec 13 16:48:10.934352 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 3/3] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 13 16:48:10 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:48:10.947023 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bf9b5e4e-dbc1-4e61-beab-9e4b9545724d tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Action: 'create', calling method: .version_select at 0x7f2149dfa4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-495736987", "metadata": {"Type": "work"}}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:10.949866 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bf9b5e4e-dbc1-4e61-beab-9e4b9545724d tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:48:10.959245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bf9b5e4e-dbc1-4e61-beab-9e4b9545724d tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023176 Dec 13 16:48:10.968147 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 4/4] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 13 16:48:10 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:48:10.982268 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-15b8117b-f30e-4ab1-a3df-66700e7a88a0 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Calling method '.version_select at 0x7f2149deaee0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:11.747603 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-15b8117b-f30e-4ab1-a3df-66700e7a88a0 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] HTTP exception thrown: Volume tempest-invalid-1856665625 could not be found. Dec 13 16:48:11.749260 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-15b8117b-f30e-4ab1-a3df-66700e7a88a0 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Returning 404 to user: Volume tempest-invalid-1856665625 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:48:11.750739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-15b8117b-f30e-4ab1-a3df-66700e7a88a0 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1856665625" status: 404 len: 99 microversion: 2.1 time: 0.779993 Dec 13 16:48:11.757900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 5/5] 10.222.0.62 () {58 vars in 1217 bytes} [Mon Dec 13 16:48:10 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1856665625 => generated 99 bytes in 789 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 13 16:48:11.771872 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-64d4533b-c130-4435-91fe-3923efe7016b tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011634 Dec 13 16:48:11.782814 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 6/6] 10.222.0.62 () {58 vars in 1139 bytes} [Mon Dec 13 16:48:11 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 13 16:48:11.802705 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-24de8788-568c-4506-be41-097cc1995fae tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013769 Dec 13 16:48:11.806871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 7/7] 10.222.0.62 () {58 vars in 1136 bytes} [Mon Dec 13 16:48:11 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 13 16:48:11.823326 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8e1c02bf-ae48-4a94-b826-52332bbbc9a8 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Calling method '.version_select at 0x7f2149dfa160>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:11.949696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d96a8543-228c-4c4e-80cc-ee4770feb67f tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.142611 Dec 13 16:48:11.951182 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 1/8] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 13 16:48:08 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3148 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 13 16:48:11.965813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2bbb7d09-e1de-4f9c-b024-5f7c3889e5ef tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] Calling method '.version_select at 0x7f2149e319d0>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:11.983734 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-8e1c02bf-ae48-4a94-b826-52332bbbc9a8 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] HTTP exception thrown: Volume d887b4fd-a016-4d87-a693-6956ba252d46 could not be found. Dec 13 16:48:11.985785 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8e1c02bf-ae48-4a94-b826-52332bbbc9a8 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Returning 404 to user: Volume d887b4fd-a016-4d87-a693-6956ba252d46 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:48:11.986926 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8e1c02bf-ae48-4a94-b826-52332bbbc9a8 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/d887b4fd-a016-4d87-a693-6956ba252d46" status: 404 len: 109 microversion: 2.1 time: 0.172144 Dec 13 16:48:11.991454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 8/9] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 13 16:48:11 2021] DELETE /compute/v2.1/os-volumes/d887b4fd-a016-4d87-a693-6956ba252d46 => generated 109 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:48:12.060352 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2bbb7d09-e1de-4f9c-b024-5f7c3889e5ef tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a" status: 200 len: 353 microversion: 2.1 time: 0.099914 Dec 13 16:48:12.061155 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 2/10] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:11 2021] GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:12.078475 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1cc617ac-fb09-47c0-9f36-291c84709933 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Calling method '.version_select at 0x7f2149e31dc0>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:12.135454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-1cc617ac-fb09-47c0-9f36-291c84709933 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] HTTP exception thrown: Volume 19698674-93bd-46fa-9fc2-94ff54c12efd could not be found. Dec 13 16:48:12.137282 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1cc617ac-fb09-47c0-9f36-291c84709933 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] Returning 404 to user: Volume 19698674-93bd-46fa-9fc2-94ff54c12efd could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:48:12.138618 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1cc617ac-fb09-47c0-9f36-291c84709933 tempest-VolumesNegativeTest-2072558502 tempest-VolumesNegativeTest-2072558502-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/19698674-93bd-46fa-9fc2-94ff54c12efd" status: 404 len: 109 microversion: 2.1 time: 0.076130 Dec 13 16:48:12.139249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 3/11] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:12 2021] GET /compute/v2.1/os-volumes/19698674-93bd-46fa-9fc2-94ff54c12efd => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:48:12.185210 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-686005104", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "1740152f-385f-4b80-90d9-b7e70656fe21"}]}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:12.416454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] validate_networks() for [('1740152f-385f-4b80-90d9-b7e70656fe21', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:48:12.994313 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d70464a0-f86f-41bc-8ef3-7724ee8b5753 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f214a7b15e0>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:13.145863 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d70464a0-f86f-41bc-8ef3-7724ee8b5753 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f52cbf15-2a09-4929-b173-4106a8d74d39" status: 200 len: 350 microversion: 2.1 time: 0.158021 Dec 13 16:48:13.147631 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 4/12] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:12 2021] GET /compute/v2.1/os-volumes/f52cbf15-2a09-4929-b173-4106a8d74d39 => generated 350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:13.158326 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ea9ef18a-7ed5-441f-80f3-d53e4b40e9ad tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] Calling method '.version_select at 0x7f2149e458b0>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:13.269229 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ea9ef18a-7ed5-441f-80f3-d53e4b40e9ad tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a" status: 200 len: 354 microversion: 2.1 time: 0.119945 Dec 13 16:48:13.270320 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 5/13] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:13 2021] GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:13.296176 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-223a43fe-8994-4ccc-84ea-eca97b499395 tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] Calling method '.version_select at 0x7f2149e45d30>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:13.422066 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-223a43fe-8994-4ccc-84ea-eca97b499395 tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a" status: 200 len: 354 microversion: 2.1 time: 0.133970 Dec 13 16:48:13.423688 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 6/14] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:13 2021] GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:13.446508 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-27099e5c-08d2-4e31-a1dd-afb56cfac1e5 tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] Calling method '.version_select at 0x7f2149dd0670>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:13.600519 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-27099e5c-08d2-4e31-a1dd-afb56cfac1e5 tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a" status: 202 len: 0 microversion: 2.1 time: 0.157933 Dec 13 16:48:13.603756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 7/15] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 13 16:48:13 2021] DELETE /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:48:13.614780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-00dc3365-57d1-47a7-8079-d5a1a7db30e3 tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] Calling method '.version_select at 0x7f2149e45d30>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:13.733119 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-00dc3365-57d1-47a7-8079-d5a1a7db30e3 tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a" status: 200 len: 353 microversion: 2.1 time: 0.124341 Dec 13 16:48:13.733779 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:13 2021] GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:14.499852 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:48:14.500406 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:48:14.500812 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:48:14.502673 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:48:14.504010 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:48:14.536725 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:14.537599 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:14.538694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:14.540605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:14.629072 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Getting quotas for project 6612774b121e4b92a1e6994061c2f83b. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:48:14.646535 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Getting quotas for user d76292ab10394b30bd758ee171574c82 and project 6612774b121e4b92a1e6994061c2f83b. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:48:14.671679 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:48:14.687367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:48:14.746238 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d16761b0-e566-4371-bb3f-2d965fba0e5b tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] Calling method '.version_select at 0x7f2149e45550>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:14.824791 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-d16761b0-e566-4371-bb3f-2d965fba0e5b tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] HTTP exception thrown: Volume bfb6e87c-69ce-442a-817e-6407aa494a4a could not be found. Dec 13 16:48:14.825950 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d16761b0-e566-4371-bb3f-2d965fba0e5b tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] Returning 404 to user: Volume bfb6e87c-69ce-442a-817e-6407aa494a4a could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:48:14.827637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d16761b0-e566-4371-bb3f-2d965fba0e5b tempest-VolumesGetTestJSON-609759791 tempest-VolumesGetTestJSON-609759791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a" status: 404 len: 109 microversion: 2.1 time: 0.084985 Dec 13 16:48:14.828767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 9/17] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:14 2021] GET /compute/v2.1/os-volumes/bfb6e87c-69ce-442a-817e-6407aa494a4a => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:48:14.867175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e33b192d-5c62-47c3-bae0-6c924514dd04 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f214a7b1820>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:14.958588 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e33b192d-5c62-47c3-bae0-6c924514dd04 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/857423d7-0c4a-4c96-a712-9fbe235944af" status: 200 len: 351 microversion: 2.1 time: 0.096969 Dec 13 16:48:14.959487 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 10/18] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:48:14 2021] GET /compute/v2.1/os-volumes/857423d7-0c4a-4c96-a712-9fbe235944af => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:14.971358 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1c39a567-b67f-438e-aa45-9956b47e3d2d tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f2149e45ee0>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:14.999264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f2777d11-5c8b-4365-b4c3-071905183449 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.004977 Dec 13 16:48:15.004729 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 9/19] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:48:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 3012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:48:15.019969 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f0c13e58-4cbe-459b-b30c-d49698d40b50 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:15.025341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f0c13e58-4cbe-459b-b30c-d49698d40b50 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:15.292808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1c39a567-b67f-438e-aa45-9956b47e3d2d tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.325366 Dec 13 16:48:15.294356 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 11/20] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Dec 13 16:48:14 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:15.309833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-178dd706-10be-4dc1-9f99-7dbaeec5b7d9 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f2149dd0820>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:15.330183 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f0c13e58-4cbe-459b-b30c-d49698d40b50 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:15.352402 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f0c13e58-4cbe-459b-b30c-d49698d40b50 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1214 microversion: 2.1 time: 0.341969 Dec 13 16:48:15.369998 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 10/21] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:15 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:15.495734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-178dd706-10be-4dc1-9f99-7dbaeec5b7d9 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.190961 Dec 13 16:48:15.496417 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 12/22] 10.222.0.62 () {58 vars in 1148 bytes} [Mon Dec 13 16:48:15 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:15.512779 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-943282f2-e845-4477-b6ed-17ac71e4dc04 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f2148c9fb80>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:15.725606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-943282f2-e845-4477-b6ed-17ac71e4dc04 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.216351 Dec 13 16:48:15.733264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1133 bytes} [Mon Dec 13 16:48:15 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:15.739266 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5a65af01-1463-40f2-8aaa-5cbe771e56cb tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f2149ddb310>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:15.931259 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5a65af01-1463-40f2-8aaa-5cbe771e56cb tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.196198 Dec 13 16:48:15.940310 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 13/24] 10.222.0.62 () {58 vars in 1166 bytes} [Mon Dec 13 16:48:15 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:15.946795 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-afbf535e-e03f-45f2-885c-57469a4572ed tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f2149e08c10>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:16.158514 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-afbf535e-e03f-45f2-885c-57469a4572ed tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.216331 Dec 13 16:48:16.159295 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 12/25] 10.222.0.62 () {58 vars in 1169 bytes} [Mon Dec 13 16:48:15 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:16.175759 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cf898077-7807-40d9-ae13-069ed41a48b7 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f2149ddbaf0>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:16.368626 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cf898077-7807-40d9-ae13-069ed41a48b7 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.197624 Dec 13 16:48:16.403347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 14/26] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Dec 13 16:48:16 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:16.434161 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e546bb01-fe27-468b-8a21-f7131ad18bf6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:16.437791 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e546bb01-fe27-468b-8a21-f7131ad18bf6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:16.445727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-51097636-a425-471c-948b-1ff3b9a96d1d tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f2149dd0160>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:16.782553 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e546bb01-fe27-468b-8a21-f7131ad18bf6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:16.790197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e546bb01-fe27-468b-8a21-f7131ad18bf6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1214 microversion: 2.1 time: 0.401395 Dec 13 16:48:16.797784 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 13/27] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:16 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1214 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:16.869716 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-51097636-a425-471c-948b-1ff3b9a96d1d tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.456197 Dec 13 16:48:16.870369 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 15/28] 10.222.0.62 () {58 vars in 1187 bytes} [Mon Dec 13 16:48:16 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:16.884658 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-91a7dabb-9268-4c13-89cf-ce9f4f62e5c6 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] Calling method '.version_select at 0x7f214a648a60>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:17.567136 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-91a7dabb-9268-4c13-89cf-ce9f4f62e5c6 tempest-VolumesTestJSON-1763055455 tempest-VolumesTestJSON-1763055455-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.685462 Dec 13 16:48:17.578634 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 14/29] 10.222.0.62 () {58 vars in 1154 bytes} [Mon Dec 13 16:48:16 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:17.814313 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-dc26a906-cb65-48ae-942d-585eb8989422 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:17.815552 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-dc26a906-cb65-48ae-942d-585eb8989422 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:18.135611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-dc26a906-cb65-48ae-942d-585eb8989422 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:18.170801 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-dc26a906-cb65-48ae-942d-585eb8989422 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1214 microversion: 2.1 time: 0.359887 Dec 13 16:48:18.175311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 16/30] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:17 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1214 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:19.199874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d5612323-c60d-42f6-8e55-6e72e5340388 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:19.201470 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d5612323-c60d-42f6-8e55-6e72e5340388 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:19.217181 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5612323-c60d-42f6-8e55-6e72e5340388 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:19.217659 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5612323-c60d-42f6-8e55-6e72e5340388 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:19.218580 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5612323-c60d-42f6-8e55-6e72e5340388 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:19.219117 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5612323-c60d-42f6-8e55-6e72e5340388 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:19.670246 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d5612323-c60d-42f6-8e55-6e72e5340388 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:19.706934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d5612323-c60d-42f6-8e55-6e72e5340388 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1266 microversion: 2.1 time: 0.518854 Dec 13 16:48:19.712800 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 15/31] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:19 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1266 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:20.735234 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fbc6115a-0dbd-4a49-b555-4487aabdb553 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:20.737688 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fbc6115a-0dbd-4a49-b555-4487aabdb553 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:20.764165 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fbc6115a-0dbd-4a49-b555-4487aabdb553 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:20.766292 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fbc6115a-0dbd-4a49-b555-4487aabdb553 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:20.767835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fbc6115a-0dbd-4a49-b555-4487aabdb553 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:20.768601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fbc6115a-0dbd-4a49-b555-4487aabdb553 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:21.606082 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fbc6115a-0dbd-4a49-b555-4487aabdb553 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:21.660517 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fbc6115a-0dbd-4a49-b555-4487aabdb553 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1272 microversion: 2.1 time: 0.929089 Dec 13 16:48:21.664963 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 17/32] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:20 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1272 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:22.682741 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a65f3a60-75c7-45f9-bccf-69a2a933d906 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:22.684778 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a65f3a60-75c7-45f9-bccf-69a2a933d906 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:22.703202 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a65f3a60-75c7-45f9-bccf-69a2a933d906 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:22.707692 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a65f3a60-75c7-45f9-bccf-69a2a933d906 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:22.713207 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a65f3a60-75c7-45f9-bccf-69a2a933d906 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:22.717879 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a65f3a60-75c7-45f9-bccf-69a2a933d906 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:23.141160 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a65f3a60-75c7-45f9-bccf-69a2a933d906 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:23.210829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a65f3a60-75c7-45f9-bccf-69a2a933d906 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1272 microversion: 2.1 time: 0.499335 Dec 13 16:48:23.212692 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 16/33] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:22 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1272 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:24.238472 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8dcdf24f-441d-4c50-a531-70c9395dabba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:24.241347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8dcdf24f-441d-4c50-a531-70c9395dabba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:24.296033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8dcdf24f-441d-4c50-a531-70c9395dabba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:24.298806 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8dcdf24f-441d-4c50-a531-70c9395dabba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:24.303316 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8dcdf24f-441d-4c50-a531-70c9395dabba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:24.312341 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8dcdf24f-441d-4c50-a531-70c9395dabba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:27.620389 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8dcdf24f-441d-4c50-a531-70c9395dabba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:27.647082 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8dcdf24f-441d-4c50-a531-70c9395dabba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 3.415480 Dec 13 16:48:27.647536 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 18/34] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:24 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 3418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:27.917442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1bcb6a45-3c93-4905-93ff-177c48e0d031 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'create', calling method: .version_select at 0x7f2148cb5dc0>, body: {"keypair": {"name": "tempest-keypair-1898491315"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:28.098314 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-1bcb6a45-3c93-4905-93ff-177c48e0d031 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for project febd1024088a4a22984d59922da28de1. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:48:28.121709 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-1bcb6a45-3c93-4905-93ff-177c48e0d031 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for user c282fd140f5645ca89c2e64888ea1345 and project febd1024088a4a22984d59922da28de1. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:48:28.677376 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b5e14588-fa46-40fd-a35c-92bbacb3bbd7 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:28.679492 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b5e14588-fa46-40fd-a35c-92bbacb3bbd7 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:28.734771 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b5e14588-fa46-40fd-a35c-92bbacb3bbd7 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:28.750958 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b5e14588-fa46-40fd-a35c-92bbacb3bbd7 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:28.755476 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b5e14588-fa46-40fd-a35c-92bbacb3bbd7 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:28.759678 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b5e14588-fa46-40fd-a35c-92bbacb3bbd7 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:29.032754 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-1bcb6a45-3c93-4905-93ff-177c48e0d031 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for project febd1024088a4a22984d59922da28de1. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:48:29.054910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-1bcb6a45-3c93-4905-93ff-177c48e0d031 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for user c282fd140f5645ca89c2e64888ea1345 and project febd1024088a4a22984d59922da28de1. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:48:29.110683 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1bcb6a45-3c93-4905-93ff-177c48e0d031 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 2.395136 Dec 13 16:48:29.111803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 17/35] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 13 16:48:26 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:29.221044 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b5e14588-fa46-40fd-a35c-92bbacb3bbd7 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:29.245708 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b5e14588-fa46-40fd-a35c-92bbacb3bbd7 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.573079 Dec 13 16:48:29.250067 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 19/36] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:28 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:30.278870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b43cd945-31a7-4c63-aeb4-c7796a578669 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:30.280469 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b43cd945-31a7-4c63-aeb4-c7796a578669 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:30.314183 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b43cd945-31a7-4c63-aeb4-c7796a578669 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:30.314696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b43cd945-31a7-4c63-aeb4-c7796a578669 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:30.321562 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b43cd945-31a7-4c63-aeb4-c7796a578669 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:30.326347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b43cd945-31a7-4c63-aeb4-c7796a578669 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:30.756693 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b43cd945-31a7-4c63-aeb4-c7796a578669 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:30.768213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b43cd945-31a7-4c63-aeb4-c7796a578669 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.495877 Dec 13 16:48:30.770063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 20/37] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:30 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:31.145424 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-aa261f98-6d25-468e-a24e-75cdc78d0009 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'create', calling method: .version_select at 0x7f2148ca9ee0>, body: {"keypair": {"name": "tempest-keypair-1771121436"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:31.220003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-aa261f98-6d25-468e-a24e-75cdc78d0009 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:48:31.243476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-aa261f98-6d25-468e-a24e-75cdc78d0009 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for user e9c2500682e64b3a91e811a3ba09bd20 and project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:48:31.796441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-30fae75e-cc27-41ec-a269-6afe1d39a2a0 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:31.797249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-30fae75e-cc27-41ec-a269-6afe1d39a2a0 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:31.810169 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-30fae75e-cc27-41ec-a269-6afe1d39a2a0 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:31.810698 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-30fae75e-cc27-41ec-a269-6afe1d39a2a0 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:31.811581 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-30fae75e-cc27-41ec-a269-6afe1d39a2a0 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:31.816531 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-30fae75e-cc27-41ec-a269-6afe1d39a2a0 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:32.650234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-aa261f98-6d25-468e-a24e-75cdc78d0009 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:48:32.667209 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-aa261f98-6d25-468e-a24e-75cdc78d0009 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for user e9c2500682e64b3a91e811a3ba09bd20 and project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:48:32.727675 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-aa261f98-6d25-468e-a24e-75cdc78d0009 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 2.704433 Dec 13 16:48:32.730288 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 18/38] 10.222.0.62 () {62 vars in 1198 bytes} [Mon Dec 13 16:48:30 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 2708 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 13 16:48:33.418619 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-30fae75e-cc27-41ec-a269-6afe1d39a2a0 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:33.442004 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-30fae75e-cc27-41ec-a269-6afe1d39a2a0 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 1.656091 Dec 13 16:48:33.444885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 21/39] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:31 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:34.464860 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3fef2654-5045-4c1a-9c32-5c91356f6c80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:34.465679 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3fef2654-5045-4c1a-9c32-5c91356f6c80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:34.474395 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3fef2654-5045-4c1a-9c32-5c91356f6c80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:34.474943 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3fef2654-5045-4c1a-9c32-5c91356f6c80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:34.475892 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3fef2654-5045-4c1a-9c32-5c91356f6c80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:34.476501 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3fef2654-5045-4c1a-9c32-5c91356f6c80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:35.401939 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3fef2654-5045-4c1a-9c32-5c91356f6c80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:35.411693 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3fef2654-5045-4c1a-9c32-5c91356f6c80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.951415 Dec 13 16:48:35.411693 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 19/40] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:34 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:36.446345 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0729b35c-16ca-4ea2-b5e1-4df27e023242 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:36.447105 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0729b35c-16ca-4ea2-b5e1-4df27e023242 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:36.475435 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0729b35c-16ca-4ea2-b5e1-4df27e023242 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:36.476305 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0729b35c-16ca-4ea2-b5e1-4df27e023242 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:36.477980 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0729b35c-16ca-4ea2-b5e1-4df27e023242 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:36.479821 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0729b35c-16ca-4ea2-b5e1-4df27e023242 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:36.863270 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-cdc9839c-19a3-447f-8ae1-e92147fd09db req-9739e251-f17e-44d5-9866-2676a01910b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47a5040f-d727-4468-abea-234cf93a0bc4", "tag": "63bb5e65-ccad-4cfd-a423-57b9fc4c4aa3"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:36.873998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:48:36.873998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:48:36.901851 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-cdc9839c-19a3-447f-8ae1-e92147fd09db req-9739e251-f17e-44d5-9866-2676a01910b7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:36.905159 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-cdc9839c-19a3-447f-8ae1-e92147fd09db req-9739e251-f17e-44d5-9866-2676a01910b7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:36.969918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-cdc9839c-19a3-447f-8ae1-e92147fd09db req-9739e251-f17e-44d5-9866-2676a01910b7 service nova] Creating event network-changed:63bb5e65-ccad-4cfd-a423-57b9fc4c4aa3 for instance 47a5040f-d727-4468-abea-234cf93a0bc4 on hv-cinder-82160 Dec 13 16:48:36.973066 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-cdc9839c-19a3-447f-8ae1-e92147fd09db req-9739e251-f17e-44d5-9866-2676a01910b7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 13 16:48:36.976883 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d465e907-c0c2-4738-aacf-3a74ccc161fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:36.977346 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d465e907-c0c2-4738-aacf-3a74ccc161fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:36.980377 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d465e907-c0c2-4738-aacf-3a74ccc161fd None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:36.980840 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d465e907-c0c2-4738-aacf-3a74ccc161fd None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:36.999427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0729b35c-16ca-4ea2-b5e1-4df27e023242 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:37.020833 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0729b35c-16ca-4ea2-b5e1-4df27e023242 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.590599 Dec 13 16:48:37.025780 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 20/41] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:36 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:37.034598 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.compute.rpcapi [None req-d465e907-c0c2-4738-aacf-3a74ccc161fd None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 13 16:48:37.036995 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d465e907-c0c2-4738-aacf-3a74ccc161fd None None] Releasing lock "compute-rpcapi-router" {{(pid=122885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 13 16:48:37.123482 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d465e907-c0c2-4738-aacf-3a74ccc161fd None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.166474 Dec 13 16:48:37.127975 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 22/42] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:48:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:37.438640 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1288470752", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faba440c-3470-4b72-a53c-aa5da04ea307"}], "security_groups": [{"name": "tempest-securitygroup--1612641416"}], "key_name": "tempest-keypair-1898491315", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:37.835630 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] validate_networks() for [('faba440c-3470-4b72-a53c-aa5da04ea307', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:48:38.045015 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ec5e4ebe-166e-4364-81e5-19ca3e1aa040 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:38.046046 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ec5e4ebe-166e-4364-81e5-19ca3e1aa040 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:38.059531 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ec5e4ebe-166e-4364-81e5-19ca3e1aa040 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:38.060139 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ec5e4ebe-166e-4364-81e5-19ca3e1aa040 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:38.061580 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ec5e4ebe-166e-4364-81e5-19ca3e1aa040 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:38.064528 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ec5e4ebe-166e-4364-81e5-19ca3e1aa040 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:38.554855 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ec5e4ebe-166e-4364-81e5-19ca3e1aa040 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:38.567708 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ec5e4ebe-166e-4364-81e5-19ca3e1aa040 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.528497 Dec 13 16:48:38.570993 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 23/43] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:38 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:39.594455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-711981f5-2f84-41af-ad5d-2e34b8c50bc2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:39.597860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-711981f5-2f84-41af-ad5d-2e34b8c50bc2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:39.617713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-711981f5-2f84-41af-ad5d-2e34b8c50bc2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:39.618680 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-711981f5-2f84-41af-ad5d-2e34b8c50bc2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:39.620970 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-711981f5-2f84-41af-ad5d-2e34b8c50bc2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:39.622936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-711981f5-2f84-41af-ad5d-2e34b8c50bc2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:39.800514 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:48:39.802413 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:48:39.802994 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:48:39.803623 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:48:39.804329 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:48:39.822760 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:39.823214 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:39.824035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:39.824473 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:39.870800 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for project febd1024088a4a22984d59922da28de1. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:48:39.886199 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for user c282fd140f5645ca89c2e64888ea1345 and project febd1024088a4a22984d59922da28de1. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:48:39.915762 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:48:39.918297 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:48:40.048634 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ae8be82b-39a5-474e-b8db-f43d9e5574f8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.618031 Dec 13 16:48:40.050561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 21/44] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:48:37 2021] POST /compute/v2.1/servers => generated 402 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 13 16:48:40.061255 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-399679ec-babc-4231-b8a9-f6c9e1cf7d74 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:40.062303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-399679ec-babc-4231-b8a9-f6c9e1cf7d74 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:40.126760 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-711981f5-2f84-41af-ad5d-2e34b8c50bc2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:40.134839 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-711981f5-2f84-41af-ad5d-2e34b8c50bc2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.549736 Dec 13 16:48:40.135451 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 24/45] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:39 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:40.187590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1145464839", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14657912-c423-47d5-8443-b0389106e6d6"}], "security_groups": [{"name": "tempest-securitygroup--414858298"}], "key_name": "tempest-keypair-1771121436", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:40.220673 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-399679ec-babc-4231-b8a9-f6c9e1cf7d74 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:40.234874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-399679ec-babc-4231-b8a9-f6c9e1cf7d74 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1238 microversion: 2.1 time: 0.178317 Dec 13 16:48:40.244758 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 22/46] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:40 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1238 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:40.486482 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] validate_networks() for [('14657912-c423-47d5-8443-b0389106e6d6', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:48:41.152858 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9305e7d3-ec1a-4848-95ae-99057a5e6b4a tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:41.154344 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9305e7d3-ec1a-4848-95ae-99057a5e6b4a tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:41.165645 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9305e7d3-ec1a-4848-95ae-99057a5e6b4a tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:41.166593 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9305e7d3-ec1a-4848-95ae-99057a5e6b4a tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:41.167700 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9305e7d3-ec1a-4848-95ae-99057a5e6b4a tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:41.169192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9305e7d3-ec1a-4848-95ae-99057a5e6b4a tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:41.425178 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9305e7d3-ec1a-4848-95ae-99057a5e6b4a tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:41.437454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9305e7d3-ec1a-4848-95ae-99057a5e6b4a tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.288461 Dec 13 16:48:41.449356 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 23/47] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:41 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:41.454599 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-226a8c0a-251a-456a-9da3-cf408edbdcf4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:41.455539 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-226a8c0a-251a-456a-9da3-cf408edbdcf4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:41.462763 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-226a8c0a-251a-456a-9da3-cf408edbdcf4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:41.463578 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-226a8c0a-251a-456a-9da3-cf408edbdcf4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:41.464589 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-226a8c0a-251a-456a-9da3-cf408edbdcf4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:41.465171 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-226a8c0a-251a-456a-9da3-cf408edbdcf4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:41.547827 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-226a8c0a-251a-456a-9da3-cf408edbdcf4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:41.562548 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-226a8c0a-251a-456a-9da3-cf408edbdcf4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1242 microversion: 2.1 time: 0.111610 Dec 13 16:48:41.563227 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 24/48] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:41 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:41.693415 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:48:41.693972 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:48:41.694316 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:48:41.694734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:48:41.695175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:48:41.740663 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:41.741552 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:41.742692 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:41.743422 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:41.804336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:48:41.813189 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for user e9c2500682e64b3a91e811a3ba09bd20 and project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:48:41.825991 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:48:41.830585 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:48:41.984114 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1f7a3a81-312e-430e-a4bd-400570af6980 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.804489 Dec 13 16:48:41.993546 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 25/49] 10.222.0.62 () {62 vars in 1187 bytes} [Mon Dec 13 16:48:40 2021] POST /compute/v2.1/servers => generated 401 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 13 16:48:42.006337 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-daac0e93-bb0a-48ef-b85e-c0d00396c089 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:42.006959 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-daac0e93-bb0a-48ef-b85e-c0d00396c089 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:42.083494 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-daac0e93-bb0a-48ef-b85e-c0d00396c089 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:42.092957 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-daac0e93-bb0a-48ef-b85e-c0d00396c089 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:42.094385 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-daac0e93-bb0a-48ef-b85e-c0d00396c089 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:42.095708 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-daac0e93-bb0a-48ef-b85e-c0d00396c089 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1282 microversion: 2.20 time: 0.100142 Dec 13 16:48:42.106946 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 25/50] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:41 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:42.456995 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-794cf484-8605-4f64-a32a-578bd34756f6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:42.457611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-794cf484-8605-4f64-a32a-578bd34756f6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:42.473158 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-794cf484-8605-4f64-a32a-578bd34756f6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:42.473769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-794cf484-8605-4f64-a32a-578bd34756f6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:42.474808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-794cf484-8605-4f64-a32a-578bd34756f6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:42.475389 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-794cf484-8605-4f64-a32a-578bd34756f6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:42.587075 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-cc281f5c-c8a5-4317-90ca-94586bbd2e34 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:42.587075 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-cc281f5c-c8a5-4317-90ca-94586bbd2e34 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:42.588380 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cc281f5c-c8a5-4317-90ca-94586bbd2e34 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:42.588924 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cc281f5c-c8a5-4317-90ca-94586bbd2e34 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:42.589766 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cc281f5c-c8a5-4317-90ca-94586bbd2e34 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:42.590447 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cc281f5c-c8a5-4317-90ca-94586bbd2e34 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:42.677887 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-794cf484-8605-4f64-a32a-578bd34756f6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:42.685668 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-794cf484-8605-4f64-a32a-578bd34756f6 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.233693 Dec 13 16:48:42.686258 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 26/51] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:42 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:42.702912 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cc281f5c-c8a5-4317-90ca-94586bbd2e34 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:42.711026 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-cc281f5c-c8a5-4317-90ca-94586bbd2e34 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1290 microversion: 2.1 time: 0.135397 Dec 13 16:48:42.711605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 26/52] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:42 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1290 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:43.115035 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:43.116239 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:43.134007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:43.134457 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:43.135252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:43.135699 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:43.210976 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:43.220768 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:43.222960 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:43.224862 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f7c6c1c9-266f-4763-9088-43e94564dad6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1286 microversion: 2.20 time: 0.114393 Dec 13 16:48:43.226152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 27/53] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:43 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:43.703454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a519a5b0-866e-4ebf-8d4c-042d9f232c03 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:43.704211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a519a5b0-866e-4ebf-8d4c-042d9f232c03 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:43.711228 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a519a5b0-866e-4ebf-8d4c-042d9f232c03 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:43.711803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a519a5b0-866e-4ebf-8d4c-042d9f232c03 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:43.712739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a519a5b0-866e-4ebf-8d4c-042d9f232c03 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:43.713276 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a519a5b0-866e-4ebf-8d4c-042d9f232c03 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:43.728767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f9a7e594-5ec5-404d-a4ef-fdec2175eb09 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:43.729661 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f9a7e594-5ec5-404d-a4ef-fdec2175eb09 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:43.735980 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9a7e594-5ec5-404d-a4ef-fdec2175eb09 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:43.736433 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9a7e594-5ec5-404d-a4ef-fdec2175eb09 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:43.738070 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9a7e594-5ec5-404d-a4ef-fdec2175eb09 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:43.738395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9a7e594-5ec5-404d-a4ef-fdec2175eb09 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:43.810410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f9a7e594-5ec5-404d-a4ef-fdec2175eb09 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:43.825375 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f9a7e594-5ec5-404d-a4ef-fdec2175eb09 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1290 microversion: 2.1 time: 0.100920 Dec 13 16:48:43.826058 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 28/54] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:43 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:43.888360 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a519a5b0-866e-4ebf-8d4c-042d9f232c03 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:43.897626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a519a5b0-866e-4ebf-8d4c-042d9f232c03 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.197902 Dec 13 16:48:43.912669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 27/55] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:43 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:44.243268 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:44.243868 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:44.250844 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:44.251319 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:44.252089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:44.252773 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:44.319310 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:44.327809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:44.329361 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:44.330603 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-968e2f35-03da-4a0a-906c-2942425fd19f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1286 microversion: 2.20 time: 0.091063 Dec 13 16:48:44.331190 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 29/56] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:44 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:44.843287 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-42eac40d-f391-4be5-9066-830ee1bc3bad tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:44.843846 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-42eac40d-f391-4be5-9066-830ee1bc3bad tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:44.857361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-42eac40d-f391-4be5-9066-830ee1bc3bad tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:44.858503 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-42eac40d-f391-4be5-9066-830ee1bc3bad tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:44.859682 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-42eac40d-f391-4be5-9066-830ee1bc3bad tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:44.860135 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-42eac40d-f391-4be5-9066-830ee1bc3bad tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:44.921895 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3d004649-8233-4227-8dbe-4490b1665217 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:44.923233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3d004649-8233-4227-8dbe-4490b1665217 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:44.933000 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3d004649-8233-4227-8dbe-4490b1665217 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:44.934077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3d004649-8233-4227-8dbe-4490b1665217 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:44.934639 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3d004649-8233-4227-8dbe-4490b1665217 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:44.935241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3d004649-8233-4227-8dbe-4490b1665217 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:44.976516 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-42eac40d-f391-4be5-9066-830ee1bc3bad tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:44.986064 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-42eac40d-f391-4be5-9066-830ee1bc3bad tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1290 microversion: 2.1 time: 0.145900 Dec 13 16:48:44.986725 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 28/57] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:44 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1290 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:45.222300 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3d004649-8233-4227-8dbe-4490b1665217 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:45.230102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3d004649-8233-4227-8dbe-4490b1665217 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.313038 Dec 13 16:48:45.232819 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 30/58] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:44 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:45.351957 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:45.353772 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:45.387201 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:45.388841 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:45.391776 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:45.392453 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:45.488716 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:45.502428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:45.505727 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:45.513699 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ef87c9ef-3a44-40ef-a65d-77761689d8f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1334 microversion: 2.20 time: 0.168375 Dec 13 16:48:45.514796 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 29/59] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:45 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1334 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:46.003446 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-71666bbb-7c7e-4f06-9ea6-d911b3e9bac9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:46.004862 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-71666bbb-7c7e-4f06-9ea6-d911b3e9bac9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:46.011462 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-71666bbb-7c7e-4f06-9ea6-d911b3e9bac9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:46.012100 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-71666bbb-7c7e-4f06-9ea6-d911b3e9bac9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:46.013142 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-71666bbb-7c7e-4f06-9ea6-d911b3e9bac9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:46.013726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-71666bbb-7c7e-4f06-9ea6-d911b3e9bac9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:46.251024 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5d311db4-2764-46ad-b40e-95ea130c9606 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:46.252428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5d311db4-2764-46ad-b40e-95ea130c9606 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:46.265293 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d311db4-2764-46ad-b40e-95ea130c9606 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:46.266140 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d311db4-2764-46ad-b40e-95ea130c9606 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:46.269083 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d311db4-2764-46ad-b40e-95ea130c9606 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:46.270322 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d311db4-2764-46ad-b40e-95ea130c9606 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:46.323023 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-71666bbb-7c7e-4f06-9ea6-d911b3e9bac9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:46.333446 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-71666bbb-7c7e-4f06-9ea6-d911b3e9bac9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.331903 Dec 13 16:48:46.344029 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 31/60] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:45 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:46.483005 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-5d311db4-2764-46ad-b40e-95ea130c9606 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:46.492999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5d311db4-2764-46ad-b40e-95ea130c9606 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.246601 Dec 13 16:48:46.493646 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 30/61] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:46 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:46.533828 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:46.534561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:46.545150 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:46.546042 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:46.547740 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:46.548740 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:46.620083 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:46.629462 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:46.631033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:46.632476 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c749a9a6-1b70-448f-b8c9-5cd79323d38d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1334 microversion: 2.20 time: 0.102569 Dec 13 16:48:46.633327 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:46 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:48:47.352088 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4e33e557-96cc-4ce8-8c28-994afe71b4a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:47.352785 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4e33e557-96cc-4ce8-8c28-994afe71b4a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:47.362896 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4e33e557-96cc-4ce8-8c28-994afe71b4a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:47.363444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4e33e557-96cc-4ce8-8c28-994afe71b4a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:47.364341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4e33e557-96cc-4ce8-8c28-994afe71b4a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:47.364901 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4e33e557-96cc-4ce8-8c28-994afe71b4a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:47.513476 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-855d12f9-a76e-422b-b318-8b9f5ef29ac8 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:47.515004 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-855d12f9-a76e-422b-b318-8b9f5ef29ac8 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:47.521712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4e33e557-96cc-4ce8-8c28-994afe71b4a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:47.523430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-855d12f9-a76e-422b-b318-8b9f5ef29ac8 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:47.527540 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-855d12f9-a76e-422b-b318-8b9f5ef29ac8 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:47.529292 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-855d12f9-a76e-422b-b318-8b9f5ef29ac8 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:47.529974 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-855d12f9-a76e-422b-b318-8b9f5ef29ac8 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:47.537536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4e33e557-96cc-4ce8-8c28-994afe71b4a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.189674 Dec 13 16:48:47.538171 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 31/63] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:47 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:47.651567 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:47.652188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:47.659896 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:47.661231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:47.662725 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:47.663334 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:47.734122 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-855d12f9-a76e-422b-b318-8b9f5ef29ac8 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:47.740184 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:47.746532 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-855d12f9-a76e-422b-b318-8b9f5ef29ac8 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.237668 Dec 13 16:48:47.748085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 33/64] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:47 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:47.750622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:47.752170 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:47.753829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7c9a074b-3327-464e-95fb-59d738817db4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1342 microversion: 2.20 time: 0.106916 Dec 13 16:48:47.754988 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:47 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:48.554999 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8a4cc8e2-7f65-4bdd-8ab0-02ee71c78aaf tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:48.556307 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8a4cc8e2-7f65-4bdd-8ab0-02ee71c78aaf tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:48.563478 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8a4cc8e2-7f65-4bdd-8ab0-02ee71c78aaf tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:48.564267 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8a4cc8e2-7f65-4bdd-8ab0-02ee71c78aaf tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:48.565395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8a4cc8e2-7f65-4bdd-8ab0-02ee71c78aaf tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:48.566085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8a4cc8e2-7f65-4bdd-8ab0-02ee71c78aaf tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:48.767308 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c964cd99-ab1d-4be1-94f4-1d86b6ea3376 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:48.768135 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c964cd99-ab1d-4be1-94f4-1d86b6ea3376 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:48.776197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c964cd99-ab1d-4be1-94f4-1d86b6ea3376 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:48.776765 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c964cd99-ab1d-4be1-94f4-1d86b6ea3376 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:48.777591 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c964cd99-ab1d-4be1-94f4-1d86b6ea3376 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:48.778117 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c964cd99-ab1d-4be1-94f4-1d86b6ea3376 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:48.901407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8a4cc8e2-7f65-4bdd-8ab0-02ee71c78aaf tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:48.917602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8a4cc8e2-7f65-4bdd-8ab0-02ee71c78aaf tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.364086 Dec 13 16:48:48.936695 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 34/66] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:48 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:48.945952 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:48.946441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:48.989125 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:48.990348 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:48.991190 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:48.991636 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:49.129999 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:49.140686 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:49.143308 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:49.145131 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c1be13ea-bd29-453f-870f-47355c4c1dc2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1340 microversion: 2.20 time: 0.203223 Dec 13 16:48:49.146773 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 35/67] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:48 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1340 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:49.189708 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-482454f5-fec8-4886-8dd0-1b43a9132ad9 req-f0c507f0-d04a-4d17-a788-f11b7ba6ec7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2466eb-448e-4984-bf58-746c53cddaac", "tag": "2256f239-7e22-47c2-8af7-d787985f0627"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:49.200644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:48:49.200644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:48:49.226185 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c964cd99-ab1d-4be1-94f4-1d86b6ea3376 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:49.226809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-482454f5-fec8-4886-8dd0-1b43a9132ad9 req-f0c507f0-d04a-4d17-a788-f11b7ba6ec7e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:49.227435 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-482454f5-fec8-4886-8dd0-1b43a9132ad9 req-f0c507f0-d04a-4d17-a788-f11b7ba6ec7e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:49.240460 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-482454f5-fec8-4886-8dd0-1b43a9132ad9 req-f0c507f0-d04a-4d17-a788-f11b7ba6ec7e service nova] Creating event network-changed:2256f239-7e22-47c2-8af7-d787985f0627 for instance 1f2466eb-448e-4984-bf58-746c53cddaac on hv-cinder-82160 Dec 13 16:48:49.243635 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c964cd99-ab1d-4be1-94f4-1d86b6ea3376 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.481064 Dec 13 16:48:49.246627 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 33/68] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:48 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:49.247170 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-482454f5-fec8-4886-8dd0-1b43a9132ad9 req-f0c507f0-d04a-4d17-a788-f11b7ba6ec7e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069959 Dec 13 16:48:49.248274 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 36/69] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:48:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:49.935640 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-56116233-b43c-4564-9048-32688c8872cb tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:49.936399 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-56116233-b43c-4564-9048-32688c8872cb tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:49.942892 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56116233-b43c-4564-9048-32688c8872cb tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:49.943336 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56116233-b43c-4564-9048-32688c8872cb tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:49.944103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56116233-b43c-4564-9048-32688c8872cb tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:49.944806 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56116233-b43c-4564-9048-32688c8872cb tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:50.133641 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-56116233-b43c-4564-9048-32688c8872cb tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:50.141748 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-56116233-b43c-4564-9048-32688c8872cb tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.209712 Dec 13 16:48:50.142404 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 34/70] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:49 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:50.167989 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:50.168881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:50.175640 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:50.176118 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:50.177029 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:50.177575 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:50.267878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-01bcc16c-3a41-4aa5-bdc1-f703c0b77bb4 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:50.268520 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-01bcc16c-3a41-4aa5-bdc1-f703c0b77bb4 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:50.275126 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-01bcc16c-3a41-4aa5-bdc1-f703c0b77bb4 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:50.275508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-01bcc16c-3a41-4aa5-bdc1-f703c0b77bb4 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:50.276305 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-01bcc16c-3a41-4aa5-bdc1-f703c0b77bb4 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:50.276786 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-01bcc16c-3a41-4aa5-bdc1-f703c0b77bb4 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:50.405021 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:50.413997 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:50.415839 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:50.417215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8ce461a8-4f0c-4e96-bb76-1ffd99489605 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.253467 Dec 13 16:48:50.418188 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 37/71] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:50 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:50.441009 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-01bcc16c-3a41-4aa5-bdc1-f703c0b77bb4 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:50.448876 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-01bcc16c-3a41-4aa5-bdc1-f703c0b77bb4 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.185122 Dec 13 16:48:50.460541 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 35/72] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:50 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:51.159811 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-22230834-d1f8-4b88-85c6-1f1132532231 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:51.160484 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-22230834-d1f8-4b88-85c6-1f1132532231 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:51.168165 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-22230834-d1f8-4b88-85c6-1f1132532231 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:51.169879 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-22230834-d1f8-4b88-85c6-1f1132532231 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:51.170712 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-22230834-d1f8-4b88-85c6-1f1132532231 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:51.171143 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-22230834-d1f8-4b88-85c6-1f1132532231 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:51.354774 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-22230834-d1f8-4b88-85c6-1f1132532231 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:51.370102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-22230834-d1f8-4b88-85c6-1f1132532231 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.214334 Dec 13 16:48:51.371812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 38/73] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:51 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:51.439489 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:51.440835 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:51.450705 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:51.451730 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:51.453177 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:51.454628 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:51.466720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d4280ce9-1da5-4a48-9211-a82d9b53a026 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:51.467390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d4280ce9-1da5-4a48-9211-a82d9b53a026 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:51.477691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4280ce9-1da5-4a48-9211-a82d9b53a026 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:51.479700 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4280ce9-1da5-4a48-9211-a82d9b53a026 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:51.480546 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4280ce9-1da5-4a48-9211-a82d9b53a026 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:51.481006 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4280ce9-1da5-4a48-9211-a82d9b53a026 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:51.887656 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d4280ce9-1da5-4a48-9211-a82d9b53a026 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:51.888905 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:51.896213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d4280ce9-1da5-4a48-9211-a82d9b53a026 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.433590 Dec 13 16:48:51.900148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:51.900950 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 39/74] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:51 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:51.910874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:51.917731 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e196a98f-2042-422d-916e-88bc62885e8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.482298 Dec 13 16:48:51.922399 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 36/75] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:51 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:52.275874 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-429b7c8f-ad8e-4a3c-9139-12548faebb87 req-d841fdba-36bf-48a0-b0e9-13f13a9f1980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a5040f-d727-4468-abea-234cf93a0bc4", "name": "network-vif-plugged", "status": "completed", "tag": "63bb5e65-ccad-4cfd-a423-57b9fc4c4aa3"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:52.279051 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:48:52.279051 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:48:52.287639 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-429b7c8f-ad8e-4a3c-9139-12548faebb87 req-d841fdba-36bf-48a0-b0e9-13f13a9f1980 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:52.288331 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-429b7c8f-ad8e-4a3c-9139-12548faebb87 req-d841fdba-36bf-48a0-b0e9-13f13a9f1980 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:52.310896 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-429b7c8f-ad8e-4a3c-9139-12548faebb87 req-d841fdba-36bf-48a0-b0e9-13f13a9f1980 service nova] Creating event network-vif-plugged:63bb5e65-ccad-4cfd-a423-57b9fc4c4aa3 for instance 47a5040f-d727-4468-abea-234cf93a0bc4 on hv-cinder-82160 Dec 13 16:48:52.318481 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-429b7c8f-ad8e-4a3c-9139-12548faebb87 req-d841fdba-36bf-48a0-b0e9-13f13a9f1980 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.416006 Dec 13 16:48:52.322364 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 40/76] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:48:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:52.390252 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c1a6e1d1-b2e0-4bfd-b5f3-2c1c7d8d3c39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:52.390998 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c1a6e1d1-b2e0-4bfd-b5f3-2c1c7d8d3c39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:52.397425 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1a6e1d1-b2e0-4bfd-b5f3-2c1c7d8d3c39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:52.398001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1a6e1d1-b2e0-4bfd-b5f3-2c1c7d8d3c39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:52.398871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1a6e1d1-b2e0-4bfd-b5f3-2c1c7d8d3c39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:52.399172 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1a6e1d1-b2e0-4bfd-b5f3-2c1c7d8d3c39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:52.667852 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c1a6e1d1-b2e0-4bfd-b5f3-2c1c7d8d3c39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:52.686850 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c1a6e1d1-b2e0-4bfd-b5f3-2c1c7d8d3c39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.300493 Dec 13 16:48:52.687441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 37/77] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:52 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:52.834718 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-7e31d0b4-0b3f-4787-971e-64012326ebd4 req-7ac8d3eb-4ea1-4b63-8fe2-11c0c085d58f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b9554f-cedc-4ce0-a3d7-c4be33ec154f", "tag": "b5225bcb-5258-419f-8497-ad84cf3faa1c"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:48:52.835944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:48:52.835944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:48:52.843323 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-7e31d0b4-0b3f-4787-971e-64012326ebd4 req-7ac8d3eb-4ea1-4b63-8fe2-11c0c085d58f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:52.843751 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-7e31d0b4-0b3f-4787-971e-64012326ebd4 req-7ac8d3eb-4ea1-4b63-8fe2-11c0c085d58f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:52.856604 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-7e31d0b4-0b3f-4787-971e-64012326ebd4 req-7ac8d3eb-4ea1-4b63-8fe2-11c0c085d58f service nova] Creating event network-changed:b5225bcb-5258-419f-8497-ad84cf3faa1c for instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f on hv-cinder-82160 Dec 13 16:48:52.862157 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-7e31d0b4-0b3f-4787-971e-64012326ebd4 req-7ac8d3eb-4ea1-4b63-8fe2-11c0c085d58f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167512 Dec 13 16:48:52.862779 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 41/78] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:48:52.922191 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c94681f0-bdf6-4a8b-a8fc-ed73afaa8fbe tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:52.923043 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c94681f0-bdf6-4a8b-a8fc-ed73afaa8fbe tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:52.932530 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c94681f0-bdf6-4a8b-a8fc-ed73afaa8fbe tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:52.934666 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c94681f0-bdf6-4a8b-a8fc-ed73afaa8fbe tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:52.938695 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c94681f0-bdf6-4a8b-a8fc-ed73afaa8fbe tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:52.939769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c94681f0-bdf6-4a8b-a8fc-ed73afaa8fbe tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:52.944197 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:52.945465 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:52.953165 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:52.954053 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:52.954981 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:52.955672 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:53.128733 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:53.142257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:53.145022 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:53.146152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b916f08d-6911-4c8c-b167-92924451a68c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.209642 Dec 13 16:48:53.146730 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 42/79] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:52 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:53.305418 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c94681f0-bdf6-4a8b-a8fc-ed73afaa8fbe tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:53.312950 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c94681f0-bdf6-4a8b-a8fc-ed73afaa8fbe tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.394308 Dec 13 16:48:53.313606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 38/80] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:52 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:53.711015 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-063ecf59-d189-4ee3-b6a9-662cec6db3f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:53.712851 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-063ecf59-d189-4ee3-b6a9-662cec6db3f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:53.726574 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-063ecf59-d189-4ee3-b6a9-662cec6db3f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:53.727353 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-063ecf59-d189-4ee3-b6a9-662cec6db3f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:53.728777 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-063ecf59-d189-4ee3-b6a9-662cec6db3f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:53.729555 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-063ecf59-d189-4ee3-b6a9-662cec6db3f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:53.909102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-063ecf59-d189-4ee3-b6a9-662cec6db3f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:53.918399 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-063ecf59-d189-4ee3-b6a9-662cec6db3f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.217086 Dec 13 16:48:53.918985 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 43/81] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:53 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:54.167735 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:54.168707 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:54.180415 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:54.180702 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:54.181955 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:54.182929 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:54.335910 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7e4978b3-f311-4cfe-838d-dc571e19db94 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:54.341232 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7e4978b3-f311-4cfe-838d-dc571e19db94 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:54.351872 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7e4978b3-f311-4cfe-838d-dc571e19db94 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:54.353025 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7e4978b3-f311-4cfe-838d-dc571e19db94 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:54.360077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7e4978b3-f311-4cfe-838d-dc571e19db94 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:54.360077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7e4978b3-f311-4cfe-838d-dc571e19db94 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:54.360473 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:54.375087 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:54.377618 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:54.378764 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c9fd0edc-c0ba-4d69-bea1-d72fb1253c84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.217909 Dec 13 16:48:54.384181 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 39/82] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:54 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:54.937637 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0e82fd98-e2b4-42b2-b176-230c9e17a703 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:54.938635 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0e82fd98-e2b4-42b2-b176-230c9e17a703 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:54.948071 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0e82fd98-e2b4-42b2-b176-230c9e17a703 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:54.948490 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0e82fd98-e2b4-42b2-b176-230c9e17a703 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:54.949794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0e82fd98-e2b4-42b2-b176-230c9e17a703 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:54.950218 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0e82fd98-e2b4-42b2-b176-230c9e17a703 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:54.974565 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7e4978b3-f311-4cfe-838d-dc571e19db94 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:54.996072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7e4978b3-f311-4cfe-838d-dc571e19db94 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.667149 Dec 13 16:48:54.996694 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 44/83] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:54 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:55.215307 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0e82fd98-e2b4-42b2-b176-230c9e17a703 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:55.224697 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0e82fd98-e2b4-42b2-b176-230c9e17a703 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.291003 Dec 13 16:48:55.225478 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 40/84] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:54 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:48:55.396862 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:55.397717 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:55.403517 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:55.403994 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:55.404821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:55.405252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:55.573801 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:55.598440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:55.599979 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:55.606907 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7313b7d8-ed76-4dea-bd20-4c796ae845ea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.213866 Dec 13 16:48:55.607665 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 45/85] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:55 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:48:56.020346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4f1185c9-3591-4611-a695-6f59662eb129 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:56.021265 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4f1185c9-3591-4611-a695-6f59662eb129 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:56.027655 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4f1185c9-3591-4611-a695-6f59662eb129 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:56.028395 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4f1185c9-3591-4611-a695-6f59662eb129 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:56.029320 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4f1185c9-3591-4611-a695-6f59662eb129 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:56.029843 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4f1185c9-3591-4611-a695-6f59662eb129 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:56.209799 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4f1185c9-3591-4611-a695-6f59662eb129 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:56.218849 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4f1185c9-3591-4611-a695-6f59662eb129 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.207417 Dec 13 16:48:56.220361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 41/86] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:56 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:56.249712 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fdff3a03-1e46-47c2-a29b-b5f57d71c37e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:56.252278 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fdff3a03-1e46-47c2-a29b-b5f57d71c37e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:56.260473 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fdff3a03-1e46-47c2-a29b-b5f57d71c37e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:56.260955 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fdff3a03-1e46-47c2-a29b-b5f57d71c37e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:56.261732 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fdff3a03-1e46-47c2-a29b-b5f57d71c37e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:56.262139 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fdff3a03-1e46-47c2-a29b-b5f57d71c37e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:56.438598 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fdff3a03-1e46-47c2-a29b-b5f57d71c37e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:56.448229 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fdff3a03-1e46-47c2-a29b-b5f57d71c37e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.207672 Dec 13 16:48:56.449355 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 46/87] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:56 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:56.628847 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:56.629628 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:56.635910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:56.636348 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:56.637390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:56.638028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:56.848437 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:56.860760 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:56.866027 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:56.867696 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-be12f5b0-f3f6-4e3b-997a-6556b3ed09ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.242868 Dec 13 16:48:56.868959 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 42/88] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:56 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:57.240752 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b21136ea-5d38-4168-964b-d7279aa43451 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:57.241449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b21136ea-5d38-4168-964b-d7279aa43451 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:57.253328 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b21136ea-5d38-4168-964b-d7279aa43451 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:57.256654 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b21136ea-5d38-4168-964b-d7279aa43451 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:57.256654 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b21136ea-5d38-4168-964b-d7279aa43451 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:57.256654 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b21136ea-5d38-4168-964b-d7279aa43451 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:57.434761 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b21136ea-5d38-4168-964b-d7279aa43451 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:57.446387 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b21136ea-5d38-4168-964b-d7279aa43451 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.209890 Dec 13 16:48:57.446902 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 47/89] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:57 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:57.466365 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7e825dce-a467-4867-bcc8-dd5f38a065e2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:57.469453 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7e825dce-a467-4867-bcc8-dd5f38a065e2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:57.475263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7e825dce-a467-4867-bcc8-dd5f38a065e2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:57.475817 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7e825dce-a467-4867-bcc8-dd5f38a065e2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:57.477004 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7e825dce-a467-4867-bcc8-dd5f38a065e2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:57.477444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7e825dce-a467-4867-bcc8-dd5f38a065e2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:57.647241 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7e825dce-a467-4867-bcc8-dd5f38a065e2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:57.655708 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7e825dce-a467-4867-bcc8-dd5f38a065e2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.193740 Dec 13 16:48:57.657000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 43/90] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:57 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:57.887775 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:57.888600 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:57.895269 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:57.895921 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:57.896747 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:57.897176 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:58.161653 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:58.183900 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:58.185894 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:58.191278 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7f93e77a-d963-46c9-b956-0366d3225e70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.306876 Dec 13 16:48:58.196925 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 48/91] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:57 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:58.465854 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-59ed8c6a-4177-4978-8445-564c03f6029d tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:58.466476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-59ed8c6a-4177-4978-8445-564c03f6029d tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:58.479321 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59ed8c6a-4177-4978-8445-564c03f6029d tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:58.479321 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59ed8c6a-4177-4978-8445-564c03f6029d tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:58.479321 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59ed8c6a-4177-4978-8445-564c03f6029d tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:58.479321 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59ed8c6a-4177-4978-8445-564c03f6029d tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:58.664384 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-59ed8c6a-4177-4978-8445-564c03f6029d tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:58.674629 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-59ed8c6a-4177-4978-8445-564c03f6029d tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.213644 Dec 13 16:48:58.676417 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 44/92] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:58 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:58.690247 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5ef37cfe-ac8f-4873-ad29-da1a032dc7f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:58.691216 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5ef37cfe-ac8f-4873-ad29-da1a032dc7f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:58.698336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5ef37cfe-ac8f-4873-ad29-da1a032dc7f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:58.698881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5ef37cfe-ac8f-4873-ad29-da1a032dc7f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:58.699874 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5ef37cfe-ac8f-4873-ad29-da1a032dc7f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:58.700330 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5ef37cfe-ac8f-4873-ad29-da1a032dc7f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:58.871449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5ef37cfe-ac8f-4873-ad29-da1a032dc7f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:58.889758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5ef37cfe-ac8f-4873-ad29-da1a032dc7f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.214011 Dec 13 16:48:58.890758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 49/93] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:58 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:59.215336 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:59.216311 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:59.224507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:59.225216 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:59.226000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:59.226470 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:59.403630 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:59.413461 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:59.414458 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:59.415477 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1e1e2817-e1af-4d75-99ad-ab6d1d1e41e0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.205302 Dec 13 16:48:59.425080 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 45/94] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:48:59 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:48:59.694710 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7d5022ac-3869-43fe-8fe1-b2f745c70282 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:59.697150 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7d5022ac-3869-43fe-8fe1-b2f745c70282 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:59.712610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7d5022ac-3869-43fe-8fe1-b2f745c70282 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:59.713518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7d5022ac-3869-43fe-8fe1-b2f745c70282 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:59.714395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7d5022ac-3869-43fe-8fe1-b2f745c70282 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:59.715303 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7d5022ac-3869-43fe-8fe1-b2f745c70282 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:59.872638 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7d5022ac-3869-43fe-8fe1-b2f745c70282 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:48:59.883525 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7d5022ac-3869-43fe-8fe1-b2f745c70282 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.193218 Dec 13 16:48:59.884117 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 50/95] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:59 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:48:59.919394 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4b6dc5b2-1224-4307-8024-73abfce4e61c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:48:59.919984 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4b6dc5b2-1224-4307-8024-73abfce4e61c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:48:59.927033 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4b6dc5b2-1224-4307-8024-73abfce4e61c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:59.927481 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4b6dc5b2-1224-4307-8024-73abfce4e61c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:48:59.928281 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4b6dc5b2-1224-4307-8024-73abfce4e61c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:48:59.928746 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4b6dc5b2-1224-4307-8024-73abfce4e61c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:00.091446 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4b6dc5b2-1224-4307-8024-73abfce4e61c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:00.102747 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4b6dc5b2-1224-4307-8024-73abfce4e61c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.187586 Dec 13 16:49:00.103767 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 46/96] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:48:59 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:00.435131 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:00.435920 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:00.442393 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:00.442843 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:00.443637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:00.444063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:00.602001 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:00.610148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:00.611821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:00.613034 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-119e7272-90ac-4581-9a40-6442f915f9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.182056 Dec 13 16:49:00.615689 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 51/97] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:00 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:00.903194 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c1cb8ba8-208d-4d83-960b-be0f2c22d27c tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:00.903694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c1cb8ba8-208d-4d83-960b-be0f2c22d27c tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:00.910306 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1cb8ba8-208d-4d83-960b-be0f2c22d27c tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:00.910743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1cb8ba8-208d-4d83-960b-be0f2c22d27c tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:00.911557 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1cb8ba8-208d-4d83-960b-be0f2c22d27c tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:00.911990 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1cb8ba8-208d-4d83-960b-be0f2c22d27c tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:01.074605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c1cb8ba8-208d-4d83-960b-be0f2c22d27c tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:01.088518 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c1cb8ba8-208d-4d83-960b-be0f2c22d27c tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.189999 Dec 13 16:49:01.090114 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 47/98] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:00 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:01.122226 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d027e26d-0376-41b8-8278-e5d182a1876f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:01.122820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d027e26d-0376-41b8-8278-e5d182a1876f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:01.131699 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d027e26d-0376-41b8-8278-e5d182a1876f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:01.132338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d027e26d-0376-41b8-8278-e5d182a1876f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:01.133202 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d027e26d-0376-41b8-8278-e5d182a1876f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:01.133624 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d027e26d-0376-41b8-8278-e5d182a1876f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:01.311861 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d027e26d-0376-41b8-8278-e5d182a1876f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:01.324150 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d027e26d-0376-41b8-8278-e5d182a1876f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.205685 Dec 13 16:49:01.324704 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 52/99] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:01 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:01.641874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:01.642756 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:01.653097 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:01.653666 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:01.654535 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:01.654971 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:01.864282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:01.873689 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:01.875553 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:01.877005 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-34af40ab-2bd7-4103-9535-f5d289580141 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.239907 Dec 13 16:49:01.877719 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 48/100] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:01 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:02.107267 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-70895411-d8fb-4b8c-8dbf-bba0b17766eb tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:02.107812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-70895411-d8fb-4b8c-8dbf-bba0b17766eb tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:02.115879 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-70895411-d8fb-4b8c-8dbf-bba0b17766eb tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:02.117122 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-70895411-d8fb-4b8c-8dbf-bba0b17766eb tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:02.118241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-70895411-d8fb-4b8c-8dbf-bba0b17766eb tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:02.118772 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-70895411-d8fb-4b8c-8dbf-bba0b17766eb tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:02.293904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-70895411-d8fb-4b8c-8dbf-bba0b17766eb tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:02.303000 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-70895411-d8fb-4b8c-8dbf-bba0b17766eb tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.199499 Dec 13 16:49:02.305511 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 53/101] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:02 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:02.354898 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4b6ed804-1fae-4ae8-b5ef-18a1c879df19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:02.356194 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4b6ed804-1fae-4ae8-b5ef-18a1c879df19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:02.371206 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4b6ed804-1fae-4ae8-b5ef-18a1c879df19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:02.371206 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4b6ed804-1fae-4ae8-b5ef-18a1c879df19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:02.374680 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4b6ed804-1fae-4ae8-b5ef-18a1c879df19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:02.375428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4b6ed804-1fae-4ae8-b5ef-18a1c879df19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:02.552114 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4b6ed804-1fae-4ae8-b5ef-18a1c879df19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:02.564388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4b6ed804-1fae-4ae8-b5ef-18a1c879df19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.217946 Dec 13 16:49:02.565644 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 49/102] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:02 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:02.897148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:02.897774 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:02.903674 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:02.904120 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:02.904928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:02.905489 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:03.072330 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:03.081970 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:03.083582 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:03.084849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-87598c83-f362-4d99-93ec-92092c817d2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.191428 Dec 13 16:49:03.085396 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 54/103] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:02 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:03.320140 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4757b04c-2064-44df-881a-de326b110f0e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:03.320874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4757b04c-2064-44df-881a-de326b110f0e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:03.329108 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4757b04c-2064-44df-881a-de326b110f0e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:03.329581 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4757b04c-2064-44df-881a-de326b110f0e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:03.330823 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4757b04c-2064-44df-881a-de326b110f0e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:03.331291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4757b04c-2064-44df-881a-de326b110f0e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:03.491232 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4757b04c-2064-44df-881a-de326b110f0e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:03.500089 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4757b04c-2064-44df-881a-de326b110f0e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.183701 Dec 13 16:49:03.500691 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 50/104] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:03 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:03.583102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-57825940-1e48-45ef-a5a5-057ba441b23d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:03.583976 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-57825940-1e48-45ef-a5a5-057ba441b23d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:03.591462 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-57825940-1e48-45ef-a5a5-057ba441b23d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:03.591905 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-57825940-1e48-45ef-a5a5-057ba441b23d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:03.592750 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-57825940-1e48-45ef-a5a5-057ba441b23d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:03.593418 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-57825940-1e48-45ef-a5a5-057ba441b23d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:03.741328 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-57825940-1e48-45ef-a5a5-057ba441b23d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:03.752800 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-57825940-1e48-45ef-a5a5-057ba441b23d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.173749 Dec 13 16:49:03.753832 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 55/105] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:03 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:04.104438 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:04.105620 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:04.113654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:04.114100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:04.114896 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:04.115310 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:04.269316 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:04.277449 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:04.278924 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:04.280441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-eff9ca84-47f9-46cb-96c6-c5ebd017a4b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.180839 Dec 13 16:49:04.280615 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 51/106] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:04 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:04.519385 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7a9fd725-855e-4c27-a411-78dc04f98991 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:04.520053 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7a9fd725-855e-4c27-a411-78dc04f98991 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:04.526696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7a9fd725-855e-4c27-a411-78dc04f98991 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:04.527126 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7a9fd725-855e-4c27-a411-78dc04f98991 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:04.527997 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7a9fd725-855e-4c27-a411-78dc04f98991 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:04.528456 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7a9fd725-855e-4c27-a411-78dc04f98991 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:04.686122 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7a9fd725-855e-4c27-a411-78dc04f98991 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:04.694630 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7a9fd725-855e-4c27-a411-78dc04f98991 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1314 microversion: 2.1 time: 0.179479 Dec 13 16:49:04.695204 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 56/107] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:04 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:04.772931 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-65fe4990-ed51-4597-ad65-0554a3967c14 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:04.773469 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-65fe4990-ed51-4597-ad65-0554a3967c14 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:04.780361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-65fe4990-ed51-4597-ad65-0554a3967c14 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:04.780840 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-65fe4990-ed51-4597-ad65-0554a3967c14 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:04.781609 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-65fe4990-ed51-4597-ad65-0554a3967c14 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:04.782035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-65fe4990-ed51-4597-ad65-0554a3967c14 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:04.923862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-65fe4990-ed51-4597-ad65-0554a3967c14 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:04.933257 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-65fe4990-ed51-4597-ad65-0554a3967c14 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.164308 Dec 13 16:49:04.933839 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 52/108] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:04 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:05.303638 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:05.304160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:05.310934 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:05.311632 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:05.312386 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:05.312993 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:05.521632 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:05.530944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:05.532710 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:05.533982 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fb01b252-8e59-4b6f-9ddc-9cdd9ccea736 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.237890 Dec 13 16:49:05.543225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 57/109] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:05 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:05.714520 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f211f252-0d59-452b-b9a2-15b74a014aba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:05.715619 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f211f252-0d59-452b-b9a2-15b74a014aba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:05.725409 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f211f252-0d59-452b-b9a2-15b74a014aba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:05.726045 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f211f252-0d59-452b-b9a2-15b74a014aba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:05.727163 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f211f252-0d59-452b-b9a2-15b74a014aba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:05.728027 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f211f252-0d59-452b-b9a2-15b74a014aba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:05.902099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f211f252-0d59-452b-b9a2-15b74a014aba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:05.910893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f211f252-0d59-452b-b9a2-15b74a014aba tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1500 microversion: 2.1 time: 0.201126 Dec 13 16:49:05.912919 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 53/110] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:05 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1500 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:05.953149 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a09ea4ec-a6e9-423a-aa07-b4938b218066 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:05.954214 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a09ea4ec-a6e9-423a-aa07-b4938b218066 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:05.961812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a09ea4ec-a6e9-423a-aa07-b4938b218066 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:05.962256 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a09ea4ec-a6e9-423a-aa07-b4938b218066 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:05.963044 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a09ea4ec-a6e9-423a-aa07-b4938b218066 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:05.963481 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a09ea4ec-a6e9-423a-aa07-b4938b218066 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:06.194192 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a09ea4ec-a6e9-423a-aa07-b4938b218066 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:06.210786 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a09ea4ec-a6e9-423a-aa07-b4938b218066 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.263219 Dec 13 16:49:06.218007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 58/111] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:05 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:06.576357 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:06.577564 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:06.586459 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:06.587443 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:06.588272 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:06.588740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:06.801698 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:06.810807 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:06.812658 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:06.819128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-302dcd74-19b1-418d-81fc-9b8eb3104239 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.243768 Dec 13 16:49:06.830014 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 54/112] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:06 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:07.229713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c2f8e87e-8631-469a-ab11-fccbf98b173e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:07.231054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c2f8e87e-8631-469a-ab11-fccbf98b173e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:07.247517 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c2f8e87e-8631-469a-ab11-fccbf98b173e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:07.248210 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c2f8e87e-8631-469a-ab11-fccbf98b173e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:07.250023 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c2f8e87e-8631-469a-ab11-fccbf98b173e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:07.250450 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c2f8e87e-8631-469a-ab11-fccbf98b173e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:07.418010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c2f8e87e-8631-469a-ab11-fccbf98b173e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:07.429534 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c2f8e87e-8631-469a-ab11-fccbf98b173e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.204482 Dec 13 16:49:07.439282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9887db32-6eda-4038-bc43-03dc19715b80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a80d8606-0c26-4c14-b1fc-5b6f19688d87"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:07.439741 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9887db32-6eda-4038-bc43-03dc19715b80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:07.440428 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 59/113] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:07 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:07.448028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9887db32-6eda-4038-bc43-03dc19715b80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:07.449061 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9887db32-6eda-4038-bc43-03dc19715b80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:07.449922 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9887db32-6eda-4038-bc43-03dc19715b80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:07.450362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9887db32-6eda-4038-bc43-03dc19715b80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:07.575709 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9887db32-6eda-4038-bc43-03dc19715b80 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Acquired lock "compute-rpcapi-router" {{(pid=122886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 13 16:49:07.576955 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68c29885-27f5-4fc5-be2e-24afaf654dec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:07.577455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68c29885-27f5-4fc5-be2e-24afaf654dec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:07.578341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68c29885-27f5-4fc5-be2e-24afaf654dec None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:07.578806 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68c29885-27f5-4fc5-be2e-24afaf654dec None None] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:07.591706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.compute.rpcapi [None req-68c29885-27f5-4fc5-be2e-24afaf654dec None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 13 16:49:07.592829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68c29885-27f5-4fc5-be2e-24afaf654dec None None] Releasing lock "compute-rpcapi-router" {{(pid=122886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 13 16:49:07.837614 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:07.838225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:07.844365 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:07.844860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:07.845646 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:07.846075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:08.052875 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:08.069269 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:08.070789 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:08.072264 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6eb89ce9-a9dc-430a-844a-643263fdb647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.238587 Dec 13 16:49:08.075745 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 60/114] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:07 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:08.447527 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-73dd65c3-5be0-4638-bc7f-fd740a3d1cca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:08.448205 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-73dd65c3-5be0-4638-bc7f-fd740a3d1cca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:08.455902 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-73dd65c3-5be0-4638-bc7f-fd740a3d1cca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:08.456776 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-73dd65c3-5be0-4638-bc7f-fd740a3d1cca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:08.458252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-73dd65c3-5be0-4638-bc7f-fd740a3d1cca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:08.458890 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-73dd65c3-5be0-4638-bc7f-fd740a3d1cca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:08.603546 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-73dd65c3-5be0-4638-bc7f-fd740a3d1cca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:08.611601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-73dd65c3-5be0-4638-bc7f-fd740a3d1cca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.168393 Dec 13 16:49:08.612115 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 61/115] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:08 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:49:09.091390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:09.091860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:09.098004 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:09.098458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:09.099411 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:09.099811 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:09.314376 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:09.325059 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:09.327167 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:09.328793 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4b95841f-09ea-4ce6-b4c6-3a8ba7e1b7fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.241361 Dec 13 16:49:09.329790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 62/116] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:09 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:49:09.334912 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-187b28e7-f884-48eb-b4ec-e7a4e819ab0a req-3d8af5d1-c2aa-4277-82ce-0e1478cf97db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b9554f-cedc-4ce0-a3d7-c4be33ec154f", "name": "network-vif-plugged", "status": "completed", "tag": "b5225bcb-5258-419f-8497-ad84cf3faa1c"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:09.336487 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:09.336487 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:49:09.344284 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-187b28e7-f884-48eb-b4ec-e7a4e819ab0a req-3d8af5d1-c2aa-4277-82ce-0e1478cf97db service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:09.344772 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-187b28e7-f884-48eb-b4ec-e7a4e819ab0a req-3d8af5d1-c2aa-4277-82ce-0e1478cf97db service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:09.358079 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-187b28e7-f884-48eb-b4ec-e7a4e819ab0a req-3d8af5d1-c2aa-4277-82ce-0e1478cf97db service nova] Creating event network-vif-plugged:b5225bcb-5258-419f-8497-ad84cf3faa1c for instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f on hv-cinder-82160 Dec 13 16:49:09.364008 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-187b28e7-f884-48eb-b4ec-e7a4e819ab0a req-3d8af5d1-c2aa-4277-82ce-0e1478cf97db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032768 Dec 13 16:49:09.364860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 63/117] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:09.629550 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7c5560ce-62a5-434f-a69e-455361b027b0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:09.630231 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7c5560ce-62a5-434f-a69e-455361b027b0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:09.636520 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c5560ce-62a5-434f-a69e-455361b027b0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:09.636978 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c5560ce-62a5-434f-a69e-455361b027b0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:09.637755 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c5560ce-62a5-434f-a69e-455361b027b0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:09.638174 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c5560ce-62a5-434f-a69e-455361b027b0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:09.781813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7c5560ce-62a5-434f-a69e-455361b027b0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:09.789660 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7c5560ce-62a5-434f-a69e-455361b027b0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.164323 Dec 13 16:49:09.790130 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 64/118] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:09 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:49:10.193274 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-68c29885-27f5-4fc5-be2e-24afaf654dec None None] 10.222.0.62 "POST /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.758694 Dec 13 16:49:10.195166 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 55/119] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:49:07 2021] POST /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4/os-volume_attachments => generated 194 bytes in 2761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:49:10.348432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:10.349696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:10.358112 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:10.360128 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:10.364698 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:10.365454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:10.569851 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:10.579303 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:10.581813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:10.583144 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7475a9fb-6d45-4b54-8ed0-6a0e8e5ecea4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.239773 Dec 13 16:49:10.584336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 65/120] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:10 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:10.816707 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-dc0661af-b0e7-4ab1-ba06-28c7edeeee20 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:10.818078 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-dc0661af-b0e7-4ab1-ba06-28c7edeeee20 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:10.826538 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dc0661af-b0e7-4ab1-ba06-28c7edeeee20 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:10.826981 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dc0661af-b0e7-4ab1-ba06-28c7edeeee20 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:10.827762 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dc0661af-b0e7-4ab1-ba06-28c7edeeee20 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:10.828215 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dc0661af-b0e7-4ab1-ba06-28c7edeeee20 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:10.983229 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-dc0661af-b0e7-4ab1-ba06-28c7edeeee20 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:10.991343 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-dc0661af-b0e7-4ab1-ba06-28c7edeeee20 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.179492 Dec 13 16:49:10.992000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 56/121] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:10 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:11.395645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-aacde747-4f6b-4a5c-bf2c-5c1f8e009195 req-f244c1f4-6ce8-4585-ad67-fd0ebbea42b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2466eb-448e-4984-bf58-746c53cddaac", "name": "network-vif-plugged", "status": "completed", "tag": "2256f239-7e22-47c2-8af7-d787985f0627"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:11.397249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:11.397249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:49:11.405488 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-aacde747-4f6b-4a5c-bf2c-5c1f8e009195 req-f244c1f4-6ce8-4585-ad67-fd0ebbea42b2 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:11.405920 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-aacde747-4f6b-4a5c-bf2c-5c1f8e009195 req-f244c1f4-6ce8-4585-ad67-fd0ebbea42b2 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:11.420717 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-aacde747-4f6b-4a5c-bf2c-5c1f8e009195 req-f244c1f4-6ce8-4585-ad67-fd0ebbea42b2 service nova] Creating event network-vif-plugged:2256f239-7e22-47c2-8af7-d787985f0627 for instance 1f2466eb-448e-4984-bf58-746c53cddaac on hv-cinder-82160 Dec 13 16:49:11.427729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-aacde747-4f6b-4a5c-bf2c-5c1f8e009195 req-f244c1f4-6ce8-4585-ad67-fd0ebbea42b2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035846 Dec 13 16:49:11.428892 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 66/122] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:11.603441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:11.604113 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:11.611351 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:11.612150 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:11.613928 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:11.614366 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:11.774012 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:11.782665 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:11.784420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:11.785664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c776ee9a-9b39-4e65-978c-39c6ea144647 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.187140 Dec 13 16:49:11.786175 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 57/123] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:11 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:12.010176 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e72978f9-93c8-42a7-bde0-72da7bcccaea tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:12.010865 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e72978f9-93c8-42a7-bde0-72da7bcccaea tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:12.017271 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e72978f9-93c8-42a7-bde0-72da7bcccaea tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:12.017720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e72978f9-93c8-42a7-bde0-72da7bcccaea tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:12.018726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e72978f9-93c8-42a7-bde0-72da7bcccaea tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:12.019405 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e72978f9-93c8-42a7-bde0-72da7bcccaea tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:12.176839 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e72978f9-93c8-42a7-bde0-72da7bcccaea tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:12.187831 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e72978f9-93c8-42a7-bde0-72da7bcccaea tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.181686 Dec 13 16:49:12.188418 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 67/124] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:12 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:12.803326 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:12.803925 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:12.811885 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:12.811885 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:12.812101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:12.812540 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:12.951834 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:12.962021 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:12.963104 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:12.964483 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ce9ed477-34ca-46d0-bf72-9608deac9f18 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.164944 Dec 13 16:49:12.965109 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 58/125] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:12 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:13.205257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fe431999-8af3-4a8f-8ec8-1f3cd4ef4c90 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:13.205895 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fe431999-8af3-4a8f-8ec8-1f3cd4ef4c90 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:13.216225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fe431999-8af3-4a8f-8ec8-1f3cd4ef4c90 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:13.216788 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fe431999-8af3-4a8f-8ec8-1f3cd4ef4c90 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:13.217600 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fe431999-8af3-4a8f-8ec8-1f3cd4ef4c90 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:13.218023 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fe431999-8af3-4a8f-8ec8-1f3cd4ef4c90 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:13.382621 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fe431999-8af3-4a8f-8ec8-1f3cd4ef4c90 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:13.390598 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fe431999-8af3-4a8f-8ec8-1f3cd4ef4c90 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.189029 Dec 13 16:49:13.392645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 68/126] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:13 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:13.983669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:13.984247 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:13.990849 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:13.991293 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:13.992075 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:13.992501 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:14.152399 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:14.160826 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:14.162304 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:14.163471 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e25b2267-7f15-41ef-88ed-dedec18f330c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1407 microversion: 2.20 time: 0.183613 Dec 13 16:49:14.163986 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 59/127] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:13 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:14.407308 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cf01d4a8-c8fb-4a71-8ec9-cc3e5aa8e03d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:14.408005 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cf01d4a8-c8fb-4a71-8ec9-cc3e5aa8e03d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:14.415088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf01d4a8-c8fb-4a71-8ec9-cc3e5aa8e03d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:14.415454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf01d4a8-c8fb-4a71-8ec9-cc3e5aa8e03d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:14.416184 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf01d4a8-c8fb-4a71-8ec9-cc3e5aa8e03d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:14.416692 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf01d4a8-c8fb-4a71-8ec9-cc3e5aa8e03d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:14.596124 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cf01d4a8-c8fb-4a71-8ec9-cc3e5aa8e03d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:14.603593 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cf01d4a8-c8fb-4a71-8ec9-cc3e5aa8e03d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.199929 Dec 13 16:49:14.604177 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 69/128] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:14 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:15.181945 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:15.187625 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:15.199004 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:15.209808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:15.209808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:15.209808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:15.432832 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:15.453870 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:15.458234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:15.462450 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-19eb3125-6ca5-4b68-a243-b7c9243ea140 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1599 microversion: 2.20 time: 0.284552 Dec 13 16:49:15.463076 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 60/129] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:49:15 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1599 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:15.490561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6da6066e-1d8b-468f-a82c-f9abbd20c8b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:15.492474 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6da6066e-1d8b-468f-a82c-f9abbd20c8b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:15.503175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6da6066e-1d8b-468f-a82c-f9abbd20c8b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:15.504243 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6da6066e-1d8b-468f-a82c-f9abbd20c8b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:15.505809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6da6066e-1d8b-468f-a82c-f9abbd20c8b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:15.507629 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6da6066e-1d8b-468f-a82c-f9abbd20c8b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:15.623379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3aac4486-12e7-4d87-9456-37206a546e44 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:15.625556 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3aac4486-12e7-4d87-9456-37206a546e44 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:15.633789 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3aac4486-12e7-4d87-9456-37206a546e44 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:15.634586 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3aac4486-12e7-4d87-9456-37206a546e44 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:15.635932 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3aac4486-12e7-4d87-9456-37206a546e44 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:15.636917 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3aac4486-12e7-4d87-9456-37206a546e44 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:15.805842 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6da6066e-1d8b-468f-a82c-f9abbd20c8b8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.325513 Dec 13 16:49:15.807784 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 70/130] 10.222.0.62 () {60 vars in 1315 bytes} [Mon Dec 13 16:49:15 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:15.931869 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3aac4486-12e7-4d87-9456-37206a546e44 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:15.939388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3aac4486-12e7-4d87-9456-37206a546e44 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1364 microversion: 2.1 time: 0.321435 Dec 13 16:49:15.950379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 61/131] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:15 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:16.964212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7742f6cb-37a1-4ea8-b66d-d3ddcbcfcc97 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:16.967273 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7742f6cb-37a1-4ea8-b66d-d3ddcbcfcc97 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:16.974973 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7742f6cb-37a1-4ea8-b66d-d3ddcbcfcc97 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:16.975582 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7742f6cb-37a1-4ea8-b66d-d3ddcbcfcc97 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:16.976721 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7742f6cb-37a1-4ea8-b66d-d3ddcbcfcc97 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:16.977820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7742f6cb-37a1-4ea8-b66d-d3ddcbcfcc97 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:17.297392 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7742f6cb-37a1-4ea8-b66d-d3ddcbcfcc97 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:17.306186 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7742f6cb-37a1-4ea8-b66d-d3ddcbcfcc97 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1549 microversion: 2.1 time: 0.352345 Dec 13 16:49:17.307070 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 71/132] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:16 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1549 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:17.329490 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-408b2967-c90e-4f33-bcf8-79125d20ce9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:17.334833 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-408b2967-c90e-4f33-bcf8-79125d20ce9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:17.351396 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-408b2967-c90e-4f33-bcf8-79125d20ce9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:17.353468 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-408b2967-c90e-4f33-bcf8-79125d20ce9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:17.354598 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-408b2967-c90e-4f33-bcf8-79125d20ce9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:17.354991 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-408b2967-c90e-4f33-bcf8-79125d20ce9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:17.456932 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-408b2967-c90e-4f33-bcf8-79125d20ce9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133933 Dec 13 16:49:17.459477 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 62/133] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Dec 13 16:49:17 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:17.708202 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9cff5391-d5dd-4590-a05a-8695797e8f99 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:17.709252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9cff5391-d5dd-4590-a05a-8695797e8f99 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:17.721397 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9cff5391-d5dd-4590-a05a-8695797e8f99 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:17.721875 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9cff5391-d5dd-4590-a05a-8695797e8f99 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:17.722719 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9cff5391-d5dd-4590-a05a-8695797e8f99 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:17.723156 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9cff5391-d5dd-4590-a05a-8695797e8f99 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:17.732634 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-b279e9ce-aaaf-42a0-8125-dd5b01cd46f8 req-1d4966a4-552e-4666-9b5b-ef70d224338c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b9554f-cedc-4ce0-a3d7-c4be33ec154f", "tag": "b5225bcb-5258-419f-8497-ad84cf3faa1c"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:17.734130 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:17.734130 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:49:17.749620 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-b279e9ce-aaaf-42a0-8125-dd5b01cd46f8 req-1d4966a4-552e-4666-9b5b-ef70d224338c service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:17.750062 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-b279e9ce-aaaf-42a0-8125-dd5b01cd46f8 req-1d4966a4-552e-4666-9b5b-ef70d224338c service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:17.843550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-b279e9ce-aaaf-42a0-8125-dd5b01cd46f8 req-1d4966a4-552e-4666-9b5b-ef70d224338c service nova] Creating event network-changed:b5225bcb-5258-419f-8497-ad84cf3faa1c for instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f on hv-cinder-82160 Dec 13 16:49:17.851932 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-b279e9ce-aaaf-42a0-8125-dd5b01cd46f8 req-1d4966a4-552e-4666-9b5b-ef70d224338c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124109 Dec 13 16:49:17.853708 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 63/134] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:49:19.052826 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9cff5391-d5dd-4590-a05a-8695797e8f99 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 1.348279 Dec 13 16:49:19.053481 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 72/135] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:17 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:19.819420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-dc621c31-1412-4ded-8cd6-63b5317ebcd0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:19.820626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-dc621c31-1412-4ded-8cd6-63b5317ebcd0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:19.861787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dc621c31-1412-4ded-8cd6-63b5317ebcd0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:19.862462 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dc621c31-1412-4ded-8cd6-63b5317ebcd0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:19.864861 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dc621c31-1412-4ded-8cd6-63b5317ebcd0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:19.865645 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dc621c31-1412-4ded-8cd6-63b5317ebcd0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:19.872458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-77cba079-64bd-4b78-a0e3-ebb3bbce43b1 req-37ac818b-3372-4bca-ac91-2db143fd98e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2466eb-448e-4984-bf58-746c53cddaac", "tag": "2256f239-7e22-47c2-8af7-d787985f0627"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:19.873640 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:19.873640 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:49:19.885116 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-77cba079-64bd-4b78-a0e3-ebb3bbce43b1 req-37ac818b-3372-4bca-ac91-2db143fd98e3 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:19.885809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-77cba079-64bd-4b78-a0e3-ebb3bbce43b1 req-37ac818b-3372-4bca-ac91-2db143fd98e3 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:19.900235 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-77cba079-64bd-4b78-a0e3-ebb3bbce43b1 req-37ac818b-3372-4bca-ac91-2db143fd98e3 service nova] Creating event network-changed:2256f239-7e22-47c2-8af7-d787985f0627 for instance 1f2466eb-448e-4984-bf58-746c53cddaac on hv-cinder-82160 Dec 13 16:49:19.916069 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-77cba079-64bd-4b78-a0e3-ebb3bbce43b1 req-37ac818b-3372-4bca-ac91-2db143fd98e3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048413 Dec 13 16:49:19.919991 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 73/136] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:49:19.999705 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-dc621c31-1412-4ded-8cd6-63b5317ebcd0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.194095 Dec 13 16:49:20.000346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 64/137] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:19 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:20.066495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-afefcf37-993a-4c36-b630-381d6893db8a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:20.067887 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-afefcf37-993a-4c36-b630-381d6893db8a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:20.084261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-afefcf37-993a-4c36-b630-381d6893db8a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:20.084837 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-afefcf37-993a-4c36-b630-381d6893db8a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:20.085733 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-afefcf37-993a-4c36-b630-381d6893db8a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:20.086168 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-afefcf37-993a-4c36-b630-381d6893db8a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:20.216849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-afefcf37-993a-4c36-b630-381d6893db8a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.154323 Dec 13 16:49:20.219796 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 74/138] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:20 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:21.012432 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0f13cdf6-9870-4161-902b-605c3ee41f3c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:21.013558 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0f13cdf6-9870-4161-902b-605c3ee41f3c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:21.031025 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f13cdf6-9870-4161-902b-605c3ee41f3c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:21.041258 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f13cdf6-9870-4161-902b-605c3ee41f3c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:21.042113 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f13cdf6-9870-4161-902b-605c3ee41f3c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:21.042553 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f13cdf6-9870-4161-902b-605c3ee41f3c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:21.153322 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0f13cdf6-9870-4161-902b-605c3ee41f3c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.145199 Dec 13 16:49:21.154236 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 65/139] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:21 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:21.239027 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-36bdba95-0985-4bb3-a519-af3e52396dea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:21.244727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-36bdba95-0985-4bb3-a519-af3e52396dea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:21.294600 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-36bdba95-0985-4bb3-a519-af3e52396dea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:21.297397 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-36bdba95-0985-4bb3-a519-af3e52396dea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:21.302516 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-36bdba95-0985-4bb3-a519-af3e52396dea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:21.307233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-36bdba95-0985-4bb3-a519-af3e52396dea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:21.420146 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-36bdba95-0985-4bb3-a519-af3e52396dea tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.192759 Dec 13 16:49:21.421625 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 75/140] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:21 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:22.168769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4ef5bfed-307b-43f4-9896-22d6ffd53575 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:22.170526 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4ef5bfed-307b-43f4-9896-22d6ffd53575 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:22.179768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4ef5bfed-307b-43f4-9896-22d6ffd53575 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:22.180396 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4ef5bfed-307b-43f4-9896-22d6ffd53575 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:22.181425 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4ef5bfed-307b-43f4-9896-22d6ffd53575 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:22.181704 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4ef5bfed-307b-43f4-9896-22d6ffd53575 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:22.309405 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4ef5bfed-307b-43f4-9896-22d6ffd53575 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.145864 Dec 13 16:49:22.310535 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 66/141] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:22 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:22.413703 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c73698fa-c6b0-4d84-a903-0454b12e2390 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:22.414276 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c73698fa-c6b0-4d84-a903-0454b12e2390 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:22.421182 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c73698fa-c6b0-4d84-a903-0454b12e2390 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:22.422052 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c73698fa-c6b0-4d84-a903-0454b12e2390 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:22.423027 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c73698fa-c6b0-4d84-a903-0454b12e2390 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:22.423635 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c73698fa-c6b0-4d84-a903-0454b12e2390 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:22.435723 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-247301b7-9681-432b-9fdd-a57ebc25a28e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:22.436783 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-247301b7-9681-432b-9fdd-a57ebc25a28e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:22.453252 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-247301b7-9681-432b-9fdd-a57ebc25a28e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:22.454949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c73698fa-c6b0-4d84-a903-0454b12e2390 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:49:22.458898 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-247301b7-9681-432b-9fdd-a57ebc25a28e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:22.460301 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-247301b7-9681-432b-9fdd-a57ebc25a28e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:22.460914 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-247301b7-9681-432b-9fdd-a57ebc25a28e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:22.570900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-247301b7-9681-432b-9fdd-a57ebc25a28e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.142512 Dec 13 16:49:22.571864 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 67/142] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:22 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:22.631752 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c73698fa-c6b0-4d84-a903-0454b12e2390 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "DELETE /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 204 len: 0 microversion: 2.1 time: 0.222144 Dec 13 16:49:22.632401 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 76/143] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:49:22 2021] DELETE /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 13 16:49:22.641843 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8378cee0-305d-4fc3-a06f-f8a33667c9dd tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:22.642823 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8378cee0-305d-4fc3-a06f-f8a33667c9dd tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:22.651306 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8378cee0-305d-4fc3-a06f-f8a33667c9dd tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:22.652101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8378cee0-305d-4fc3-a06f-f8a33667c9dd tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:22.653134 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8378cee0-305d-4fc3-a06f-f8a33667c9dd tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:22.653791 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8378cee0-305d-4fc3-a06f-f8a33667c9dd tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:22.858042 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8378cee0-305d-4fc3-a06f-f8a33667c9dd tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:22.868657 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8378cee0-305d-4fc3-a06f-f8a33667c9dd tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1552 microversion: 2.1 time: 0.230918 Dec 13 16:49:22.869833 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 68/144] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:22 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:23.327002 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ac83f889-8613-436b-af68-27e9945ca41c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:23.328014 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ac83f889-8613-436b-af68-27e9945ca41c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:23.344767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ac83f889-8613-436b-af68-27e9945ca41c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:23.344976 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ac83f889-8613-436b-af68-27e9945ca41c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:23.345716 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ac83f889-8613-436b-af68-27e9945ca41c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:23.346191 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ac83f889-8613-436b-af68-27e9945ca41c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:23.422119 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ac83f889-8613-436b-af68-27e9945ca41c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.105235 Dec 13 16:49:23.424666 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 77/145] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:23 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:23.583197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3c1f441c-d34c-4017-a08c-c5d0ce2abbbb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:23.584677 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3c1f441c-d34c-4017-a08c-c5d0ce2abbbb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:23.591255 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3c1f441c-d34c-4017-a08c-c5d0ce2abbbb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:23.593222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3c1f441c-d34c-4017-a08c-c5d0ce2abbbb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:23.594149 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3c1f441c-d34c-4017-a08c-c5d0ce2abbbb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:23.594903 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3c1f441c-d34c-4017-a08c-c5d0ce2abbbb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:23.688839 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3c1f441c-d34c-4017-a08c-c5d0ce2abbbb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.109073 Dec 13 16:49:23.690729 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 69/146] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:23 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:49:23.892523 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d1b7b70a-4104-4211-893d-156fd0cd5509 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:23.894300 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d1b7b70a-4104-4211-893d-156fd0cd5509 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:23.905266 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d1b7b70a-4104-4211-893d-156fd0cd5509 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:23.906249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d1b7b70a-4104-4211-893d-156fd0cd5509 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:23.907525 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d1b7b70a-4104-4211-893d-156fd0cd5509 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:23.908092 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d1b7b70a-4104-4211-893d-156fd0cd5509 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:24.207519 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d1b7b70a-4104-4211-893d-156fd0cd5509 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:24.217148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d1b7b70a-4104-4211-893d-156fd0cd5509 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1552 microversion: 2.1 time: 0.330935 Dec 13 16:49:24.217783 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 78/147] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:23 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1552 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:24.435515 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a3ba3b29-3685-4795-adb7-cf8ada97f9cc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:24.436319 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a3ba3b29-3685-4795-adb7-cf8ada97f9cc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:24.447431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a3ba3b29-3685-4795-adb7-cf8ada97f9cc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:24.447878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a3ba3b29-3685-4795-adb7-cf8ada97f9cc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:24.448714 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a3ba3b29-3685-4795-adb7-cf8ada97f9cc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:24.449141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a3ba3b29-3685-4795-adb7-cf8ada97f9cc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:24.522232 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a3ba3b29-3685-4795-adb7-cf8ada97f9cc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.090683 Dec 13 16:49:24.523468 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 70/148] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:24 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:24.702793 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-de90e956-f14f-4b43-a5a6-f2f4ce1f82ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:24.704493 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-de90e956-f14f-4b43-a5a6-f2f4ce1f82ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:24.718026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-de90e956-f14f-4b43-a5a6-f2f4ce1f82ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:24.718472 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-de90e956-f14f-4b43-a5a6-f2f4ce1f82ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:24.721262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-de90e956-f14f-4b43-a5a6-f2f4ce1f82ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:24.722531 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-de90e956-f14f-4b43-a5a6-f2f4ce1f82ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:24.793733 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-de90e956-f14f-4b43-a5a6-f2f4ce1f82ac tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.096414 Dec 13 16:49:24.794768 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 79/149] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:24 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:25.235220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4329bfff-f5ea-4682-80c0-fe1e676295a2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:25.235912 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4329bfff-f5ea-4682-80c0-fe1e676295a2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:25.248294 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4329bfff-f5ea-4682-80c0-fe1e676295a2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:25.249724 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4329bfff-f5ea-4682-80c0-fe1e676295a2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:25.250601 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4329bfff-f5ea-4682-80c0-fe1e676295a2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:25.251031 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4329bfff-f5ea-4682-80c0-fe1e676295a2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:25.396943 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4329bfff-f5ea-4682-80c0-fe1e676295a2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:25.409730 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4329bfff-f5ea-4682-80c0-fe1e676295a2 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1510 microversion: 2.1 time: 0.177716 Dec 13 16:49:25.412706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 71/150] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:25 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:25.536269 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f4c37728-f37a-4a05-a7a2-194a834f4d39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:25.536269 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f4c37728-f37a-4a05-a7a2-194a834f4d39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:25.543322 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4c37728-f37a-4a05-a7a2-194a834f4d39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:25.543952 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4c37728-f37a-4a05-a7a2-194a834f4d39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:25.545007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4c37728-f37a-4a05-a7a2-194a834f4d39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:25.547567 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4c37728-f37a-4a05-a7a2-194a834f4d39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:25.604868 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-824d7446-ec9a-44d7-9d65-6a2ab66b1e16 req-50eb7dd6-2efb-44ad-a410-97088f62fea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47a5040f-d727-4468-abea-234cf93a0bc4", "name": "network-vif-deleted", "tag": "63bb5e65-ccad-4cfd-a423-57b9fc4c4aa3"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:25.606724 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:25.606724 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:49:25.617983 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-824d7446-ec9a-44d7-9d65-6a2ab66b1e16 req-50eb7dd6-2efb-44ad-a410-97088f62fea2 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:25.624264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-824d7446-ec9a-44d7-9d65-6a2ab66b1e16 req-50eb7dd6-2efb-44ad-a410-97088f62fea2 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:25.641971 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-824d7446-ec9a-44d7-9d65-6a2ab66b1e16 req-50eb7dd6-2efb-44ad-a410-97088f62fea2 service nova] Creating event network-vif-deleted:63bb5e65-ccad-4cfd-a423-57b9fc4c4aa3 for instance 47a5040f-d727-4468-abea-234cf93a0bc4 on hv-cinder-82160 Dec 13 16:49:25.648445 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-824d7446-ec9a-44d7-9d65-6a2ab66b1e16 req-50eb7dd6-2efb-44ad-a410-97088f62fea2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047278 Dec 13 16:49:25.650978 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 72/151] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:25.663797 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f4c37728-f37a-4a05-a7a2-194a834f4d39 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.133214 Dec 13 16:49:25.666895 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 80/152] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:25 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:25.808501 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b0ca9b36-0901-4bd5-b03a-a330b18806c8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:25.811523 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b0ca9b36-0901-4bd5-b03a-a330b18806c8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:25.820077 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b0ca9b36-0901-4bd5-b03a-a330b18806c8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:25.821428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b0ca9b36-0901-4bd5-b03a-a330b18806c8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:25.822627 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b0ca9b36-0901-4bd5-b03a-a330b18806c8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:25.823837 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b0ca9b36-0901-4bd5-b03a-a330b18806c8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:25.919595 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b0ca9b36-0901-4bd5-b03a-a330b18806c8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.117176 Dec 13 16:49:25.920181 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 73/153] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:25 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:26.428695 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:26.429970 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:26.438782 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:26.439231 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:26.440129 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:26.441641 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:26.494094 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:26.494990 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:26.496004 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lazy-loading 'fault' on Instance uuid 47a5040f-d727-4468-abea-234cf93a0bc4 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:49:26.613251 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76292ab10394b30bd758ee171574c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6612774b121e4b92a1e6994061c2f83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:26.624267 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d781b76b-855d-4700-8cbf-4c18cf6e1b6e tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 200 len: 1304 microversion: 2.1 time: 0.200548 Dec 13 16:49:26.627779 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 81/154] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:26 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 1304 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:26.678827 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b270aedd-2fe0-4236-bdf2-33267ca1bb75 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:26.679857 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b270aedd-2fe0-4236-bdf2-33267ca1bb75 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:26.692254 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b270aedd-2fe0-4236-bdf2-33267ca1bb75 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:26.692722 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b270aedd-2fe0-4236-bdf2-33267ca1bb75 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:26.693664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b270aedd-2fe0-4236-bdf2-33267ca1bb75 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:26.694236 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b270aedd-2fe0-4236-bdf2-33267ca1bb75 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:26.762979 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b270aedd-2fe0-4236-bdf2-33267ca1bb75 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.090204 Dec 13 16:49:26.764664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 74/155] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:26 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:26.931554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f9ef94e2-b386-4502-b031-0c31906d75bd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:26.933044 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f9ef94e2-b386-4502-b031-0c31906d75bd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:26.942128 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9ef94e2-b386-4502-b031-0c31906d75bd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:26.943873 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9ef94e2-b386-4502-b031-0c31906d75bd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:26.945241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9ef94e2-b386-4502-b031-0c31906d75bd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:26.946150 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9ef94e2-b386-4502-b031-0c31906d75bd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:27.022729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f9ef94e2-b386-4502-b031-0c31906d75bd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.094553 Dec 13 16:49:27.024378 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 82/156] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:26 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:27.646302 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:27.647640 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:27.658688 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:27.659767 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:27.660929 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:27.661614 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:27.681865 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] HTTP exception thrown: Instance 47a5040f-d727-4468-abea-234cf93a0bc4 could not be found. Dec 13 16:49:27.682740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Returning 404 to user: Instance 47a5040f-d727-4468-abea-234cf93a0bc4 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:49:27.684558 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b635362a-c545-4f27-a2d1-d2f4b9c300d9 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 404 len: 111 microversion: 2.1 time: 0.043817 Dec 13 16:49:27.686556 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 75/157] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:27 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:49:27.788738 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5754ed3f-e1f4-49a0-b095-940fd0a8ee9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:27.788738 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5754ed3f-e1f4-49a0-b095-940fd0a8ee9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:27.809757 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5754ed3f-e1f4-49a0-b095-940fd0a8ee9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:27.810727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5754ed3f-e1f4-49a0-b095-940fd0a8ee9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:27.813016 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5754ed3f-e1f4-49a0-b095-940fd0a8ee9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:27.814336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5754ed3f-e1f4-49a0-b095-940fd0a8ee9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:27.920806 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5754ed3f-e1f4-49a0-b095-940fd0a8ee9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.142290 Dec 13 16:49:27.921731 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 83/158] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:27 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:27.923585 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:27.925527 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:27.934037 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:27.934904 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:27.935896 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:27.936605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:27.953642 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] HTTP exception thrown: Instance 47a5040f-d727-4468-abea-234cf93a0bc4 could not be found. Dec 13 16:49:27.958272 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Returning 404 to user: Instance 47a5040f-d727-4468-abea-234cf93a0bc4 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:49:27.960357 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4440feab-947b-403d-9618-86f13e398aef tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042832 Dec 13 16:49:27.961265 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 76/159] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:49:27 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:49:28.039554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8ba79d76-a031-48bb-ad2a-5bbc3e352e11 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:28.041871 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8ba79d76-a031-48bb-ad2a-5bbc3e352e11 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:28.055254 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8ba79d76-a031-48bb-ad2a-5bbc3e352e11 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:28.055922 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8ba79d76-a031-48bb-ad2a-5bbc3e352e11 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:28.058016 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8ba79d76-a031-48bb-ad2a-5bbc3e352e11 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:28.058584 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8ba79d76-a031-48bb-ad2a-5bbc3e352e11 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:28.154155 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8ba79d76-a031-48bb-ad2a-5bbc3e352e11 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.123079 Dec 13 16:49:28.157524 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 84/160] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:28 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:28.931868 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c1b10076-a982-47b3-9902-3b1757f00b07 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:28.933551 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c1b10076-a982-47b3-9902-3b1757f00b07 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:28.941993 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1b10076-a982-47b3-9902-3b1757f00b07 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:28.945869 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1b10076-a982-47b3-9902-3b1757f00b07 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:28.948039 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1b10076-a982-47b3-9902-3b1757f00b07 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:28.948854 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1b10076-a982-47b3-9902-3b1757f00b07 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:29.049119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c1b10076-a982-47b3-9902-3b1757f00b07 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.120655 Dec 13 16:49:29.051331 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 77/161] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:28 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:29.166749 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-39e8b4be-fa07-45ea-8871-357f7b36a404 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:29.169078 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-39e8b4be-fa07-45ea-8871-357f7b36a404 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:29.177218 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-39e8b4be-fa07-45ea-8871-357f7b36a404 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:29.178257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-39e8b4be-fa07-45ea-8871-357f7b36a404 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:29.179312 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-39e8b4be-fa07-45ea-8871-357f7b36a404 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:29.179984 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-39e8b4be-fa07-45ea-8871-357f7b36a404 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:29.230834 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:29.231803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:29.242507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:29.243341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:29.244289 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:29.244976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:29.259569 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-39e8b4be-fa07-45ea-8871-357f7b36a404 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14 microversion: 2.20 time: 0.096648 Dec 13 16:49:29.260515 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 85/162] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:29 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:29.261529 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] HTTP exception thrown: Instance 47a5040f-d727-4468-abea-234cf93a0bc4 could not be found. Dec 13 16:49:29.262286 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Returning 404 to user: Instance 47a5040f-d727-4468-abea-234cf93a0bc4 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:49:29.263299 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-26416fe8-0866-49d4-a0eb-8f4785077a21 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "DELETE /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 404 len: 111 microversion: 2.1 time: 0.037226 Dec 13 16:49:29.263989 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 78/163] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:49:29 2021] DELETE /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:49:29.276755 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:29.277920 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] [instance: 47a5040f-d727-4468-abea-234cf93a0bc4] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:29.288677 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:29.289583 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:29.290555 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:29.291160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:29.310328 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] HTTP exception thrown: Instance 47a5040f-d727-4468-abea-234cf93a0bc4 could not be found. Dec 13 16:49:29.311190 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] Returning 404 to user: Instance 47a5040f-d727-4468-abea-234cf93a0bc4 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:49:29.312309 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e661fc0b-b627-4d1f-8e45-28462e693b11 tempest-DeleteServersTestJSON-10280424 tempest-DeleteServersTestJSON-10280424-project] 10.222.0.62 "GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4" status: 404 len: 111 microversion: 2.1 time: 0.043801 Dec 13 16:49:29.313686 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 86/164] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:29 2021] GET /compute/v2.1/servers/47a5040f-d727-4468-abea-234cf93a0bc4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:49:30.061374 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7f9ee246-2256-4f09-97f6-8851f647abcd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:30.062946 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7f9ee246-2256-4f09-97f6-8851f647abcd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:30.071299 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7f9ee246-2256-4f09-97f6-8851f647abcd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:30.071927 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7f9ee246-2256-4f09-97f6-8851f647abcd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:30.072968 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7f9ee246-2256-4f09-97f6-8851f647abcd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:30.073618 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7f9ee246-2256-4f09-97f6-8851f647abcd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:30.143366 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7f9ee246-2256-4f09-97f6-8851f647abcd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 14 microversion: 2.1 time: 0.085215 Dec 13 16:49:30.144847 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 79/165] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:30 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:49:30.272485 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b8e8d8ed-f15d-46ac-8446-604bb4fce04c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:30.273591 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b8e8d8ed-f15d-46ac-8446-604bb4fce04c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:30.283947 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b8e8d8ed-f15d-46ac-8446-604bb4fce04c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:30.286507 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b8e8d8ed-f15d-46ac-8446-604bb4fce04c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:30.288091 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b8e8d8ed-f15d-46ac-8446-604bb4fce04c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:30.288532 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b8e8d8ed-f15d-46ac-8446-604bb4fce04c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:30.381911 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b8e8d8ed-f15d-46ac-8446-604bb4fce04c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 7043 microversion: 2.20 time: 0.114493 Dec 13 16:49:30.382601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 87/166] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:30 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 7043 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:49:31.156737 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0442f185-a3dc-4efa-956b-b7ed0a24f093 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:31.160739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0442f185-a3dc-4efa-956b-b7ed0a24f093 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:31.170108 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0442f185-a3dc-4efa-956b-b7ed0a24f093 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:31.171977 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0442f185-a3dc-4efa-956b-b7ed0a24f093 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:31.173705 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0442f185-a3dc-4efa-956b-b7ed0a24f093 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:31.175819 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0442f185-a3dc-4efa-956b-b7ed0a24f093 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:31.282474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0442f185-a3dc-4efa-956b-b7ed0a24f093 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 452 microversion: 2.1 time: 0.130215 Dec 13 16:49:31.283835 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 80/167] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:31 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:31.395542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4acb2027-9f82-4194-b74c-11066d894041 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:31.397051 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4acb2027-9f82-4194-b74c-11066d894041 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:31.407202 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4acb2027-9f82-4194-b74c-11066d894041 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:31.407930 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4acb2027-9f82-4194-b74c-11066d894041 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:31.409746 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4acb2027-9f82-4194-b74c-11066d894041 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:31.410623 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4acb2027-9f82-4194-b74c-11066d894041 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:31.507560 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4acb2027-9f82-4194-b74c-11066d894041 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 14558 microversion: 2.20 time: 0.117005 Dec 13 16:49:31.508540 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 88/168] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:31 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 14558 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:32.299235 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ec2a2195-4d47-4a6b-b6f3-dcfe53cd76f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:32.304553 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ec2a2195-4d47-4a6b-b6f3-dcfe53cd76f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:32.318090 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ec2a2195-4d47-4a6b-b6f3-dcfe53cd76f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:32.319294 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ec2a2195-4d47-4a6b-b6f3-dcfe53cd76f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:32.320522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ec2a2195-4d47-4a6b-b6f3-dcfe53cd76f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:32.321097 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ec2a2195-4d47-4a6b-b6f3-dcfe53cd76f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:32.414390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ec2a2195-4d47-4a6b-b6f3-dcfe53cd76f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 10009 microversion: 2.1 time: 0.122315 Dec 13 16:49:32.415140 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 81/169] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:32 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 10009 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:32.530780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-63950bb0-2769-4b26-93ca-b8a32037b77a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:32.532775 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-63950bb0-2769-4b26-93ca-b8a32037b77a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:32.550983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63950bb0-2769-4b26-93ca-b8a32037b77a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:32.551729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63950bb0-2769-4b26-93ca-b8a32037b77a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:32.552870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63950bb0-2769-4b26-93ca-b8a32037b77a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:32.553687 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63950bb0-2769-4b26-93ca-b8a32037b77a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:32.681130 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-63950bb0-2769-4b26-93ca-b8a32037b77a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 18155 microversion: 2.20 time: 0.162708 Dec 13 16:49:32.681819 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 89/170] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:32 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 18155 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:33.432366 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6b65b736-0587-4719-a1c9-beff352a44d8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:33.435138 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6b65b736-0587-4719-a1c9-beff352a44d8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:33.460881 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6b65b736-0587-4719-a1c9-beff352a44d8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:33.461995 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6b65b736-0587-4719-a1c9-beff352a44d8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:33.463237 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6b65b736-0587-4719-a1c9-beff352a44d8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:33.463929 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6b65b736-0587-4719-a1c9-beff352a44d8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:33.590410 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6b65b736-0587-4719-a1c9-beff352a44d8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 15800 microversion: 2.1 time: 0.167737 Dec 13 16:49:33.591713 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 82/171] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:33 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 15800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:33.697095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5bd86949-1a3d-4c5d-a985-d8091473011c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:33.698132 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5bd86949-1a3d-4c5d-a985-d8091473011c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:33.717715 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5bd86949-1a3d-4c5d-a985-d8091473011c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:33.718158 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5bd86949-1a3d-4c5d-a985-d8091473011c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:33.718958 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5bd86949-1a3d-4c5d-a985-d8091473011c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:33.719385 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5bd86949-1a3d-4c5d-a985-d8091473011c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:33.825415 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5bd86949-1a3d-4c5d-a985-d8091473011c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 19096 microversion: 2.20 time: 0.132951 Dec 13 16:49:33.826499 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 90/172] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:33 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 19096 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:49:34.612054 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0eba1491-03be-42e5-9fc9-6afcf23b1158 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:34.615283 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0eba1491-03be-42e5-9fc9-6afcf23b1158 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:34.660388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0eba1491-03be-42e5-9fc9-6afcf23b1158 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:34.660870 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0eba1491-03be-42e5-9fc9-6afcf23b1158 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:34.661687 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0eba1491-03be-42e5-9fc9-6afcf23b1158 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:34.664383 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0eba1491-03be-42e5-9fc9-6afcf23b1158 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:34.840785 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e15cf35c-1caf-4afc-b784-550601fd7209 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:34.842542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e15cf35c-1caf-4afc-b784-550601fd7209 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:34.867012 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e15cf35c-1caf-4afc-b784-550601fd7209 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:34.867710 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e15cf35c-1caf-4afc-b784-550601fd7209 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:34.869010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e15cf35c-1caf-4afc-b784-550601fd7209 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:34.869890 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e15cf35c-1caf-4afc-b784-550601fd7209 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:37.343003 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e15cf35c-1caf-4afc-b784-550601fd7209 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 24939 microversion: 2.20 time: 2.495185 Dec 13 16:49:37.343003 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 91/173] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:34 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 24939 bytes in 2497 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:37.356308 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0eba1491-03be-42e5-9fc9-6afcf23b1158 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 22977 microversion: 2.1 time: 2.749341 Dec 13 16:49:37.363293 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 83/174] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:34 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 22977 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:38.345485 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-38860404-895b-4329-bad0-63d9c16168be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:38.347542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-38860404-895b-4329-bad0-63d9c16168be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:38.356825 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-38860404-895b-4329-bad0-63d9c16168be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:38.357531 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-38860404-895b-4329-bad0-63d9c16168be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:38.358494 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-38860404-895b-4329-bad0-63d9c16168be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:38.359638 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-38860404-895b-4329-bad0-63d9c16168be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:38.372334 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-dca7202c-f72e-40ab-b2a7-2f59c1edc7d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:38.374074 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-dca7202c-f72e-40ab-b2a7-2f59c1edc7d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:38.388493 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dca7202c-f72e-40ab-b2a7-2f59c1edc7d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:38.391183 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dca7202c-f72e-40ab-b2a7-2f59c1edc7d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:38.393675 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dca7202c-f72e-40ab-b2a7-2f59c1edc7d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:38.394386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dca7202c-f72e-40ab-b2a7-2f59c1edc7d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:38.496841 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-38860404-895b-4329-bad0-63d9c16168be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 26327 microversion: 2.20 time: 0.156690 Dec 13 16:49:38.498127 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 92/175] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:38 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 26327 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:38.528151 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-dca7202c-f72e-40ab-b2a7-2f59c1edc7d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 24393 microversion: 2.1 time: 0.159996 Dec 13 16:49:38.531930 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 84/176] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:38 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 24393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:39.377913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-411506495", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8652ce83-d216-44fa-8946-071181554706"}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:39.478330 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] validate_networks() for [('8652ce83-d216-44fa-8946-071181554706', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:49:39.510790 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a30490f0-e360-4d58-bd3e-eb1cd388c9d8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:39.512412 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a30490f0-e360-4d58-bd3e-eb1cd388c9d8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:39.531011 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a30490f0-e360-4d58-bd3e-eb1cd388c9d8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:39.531488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a30490f0-e360-4d58-bd3e-eb1cd388c9d8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:39.532420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a30490f0-e360-4d58-bd3e-eb1cd388c9d8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:39.533233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a30490f0-e360-4d58-bd3e-eb1cd388c9d8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:39.639029 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a30490f0-e360-4d58-bd3e-eb1cd388c9d8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 27202 microversion: 2.20 time: 0.133603 Dec 13 16:49:39.640343 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 85/177] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:39 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 27202 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:49:39.645332 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d5ade6ec-4e7f-4edc-a610-f72fdba48f21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:39.649882 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d5ade6ec-4e7f-4edc-a610-f72fdba48f21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:39.677128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5ade6ec-4e7f-4edc-a610-f72fdba48f21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:39.678787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5ade6ec-4e7f-4edc-a610-f72fdba48f21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:39.680106 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5ade6ec-4e7f-4edc-a610-f72fdba48f21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:39.680658 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5ade6ec-4e7f-4edc-a610-f72fdba48f21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:39.774717 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d5ade6ec-4e7f-4edc-a610-f72fdba48f21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 25958 microversion: 2.1 time: 0.132421 Dec 13 16:49:39.776979 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 86/178] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:39 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 25958 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:40.027981 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:49:40.028477 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:49:40.029109 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:49:40.029354 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:49:40.029818 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:49:40.042517 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:40.043539 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:40.044659 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:40.045139 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:40.069186 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Getting quotas for project ab0bde5e0af14db49800fbdb92510291. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:49:40.081030 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Getting quotas for user 17b84b9ba4894db6985fcf9da882f56c and project ab0bde5e0af14db49800fbdb92510291. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:49:40.105891 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:49:40.110720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:49:40.181250 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-50e3fab4-5b8e-4050-a9e5-cce422341f3c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.052704 Dec 13 16:49:40.182349 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 93/179] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:49:39 2021] POST /compute/v2.1/servers => generated 383 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:49:40.195605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9334740d-b172-4e15-895d-175f5ce66876 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:40.196607 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9334740d-b172-4e15-895d-175f5ce66876 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:40.289378 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9334740d-b172-4e15-895d-175f5ce66876 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:40.300257 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9334740d-b172-4e15-895d-175f5ce66876 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1221 microversion: 2.1 time: 0.111173 Dec 13 16:49:40.301687 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 87/180] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:40 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:40.393998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1353517499", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8652ce83-d216-44fa-8946-071181554706"}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:40.495421 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] validate_networks() for [('8652ce83-d216-44fa-8946-071181554706', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:49:40.653734 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7466a253-351d-4f5d-be2c-3deffd1c7c50 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:40.654775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7466a253-351d-4f5d-be2c-3deffd1c7c50 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:40.668782 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7466a253-351d-4f5d-be2c-3deffd1c7c50 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:40.669555 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7466a253-351d-4f5d-be2c-3deffd1c7c50 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:40.670870 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7466a253-351d-4f5d-be2c-3deffd1c7c50 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:40.671465 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7466a253-351d-4f5d-be2c-3deffd1c7c50 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:40.956326 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:49:40.956776 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:49:40.957437 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:49:40.958116 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:49:40.958955 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:49:40.973149 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:40.973888 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:40.975670 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:40.975927 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:41.008183 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Getting quotas for project ab0bde5e0af14db49800fbdb92510291. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:49:41.009113 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Getting quotas for user 17b84b9ba4894db6985fcf9da882f56c and project ab0bde5e0af14db49800fbdb92510291. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:49:41.020483 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:49:41.022715 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:49:41.075671 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-05791343-e4e2-43e7-ba4e-41f58c688fca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.687367 Dec 13 16:49:41.081601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 94/181] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:49:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:49:41.081601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9fa3bbfc-8351-4762-8bc7-00694d0f4330 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:41.082556 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9fa3bbfc-8351-4762-8bc7-00694d0f4330 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:41.089877 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fa3bbfc-8351-4762-8bc7-00694d0f4330 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:41.090379 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fa3bbfc-8351-4762-8bc7-00694d0f4330 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:41.091180 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fa3bbfc-8351-4762-8bc7-00694d0f4330 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:41.091610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fa3bbfc-8351-4762-8bc7-00694d0f4330 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:42.501228 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7466a253-351d-4f5d-be2c-3deffd1c7c50 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 27904 microversion: 2.20 time: 1.851110 Dec 13 16:49:42.503282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 88/182] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:40 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 27904 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:49:42.510259 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-438eb401-ca1d-4709-ba70-a198e4d1f72a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:42.510951 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-438eb401-ca1d-4709-ba70-a198e4d1f72a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:42.524528 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9fa3bbfc-8351-4762-8bc7-00694d0f4330 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 27748 microversion: 2.1 time: 1.446722 Dec 13 16:49:42.526245 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 95/183] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:41 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 27748 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:42.532423 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-438eb401-ca1d-4709-ba70-a198e4d1f72a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:42.533653 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-438eb401-ca1d-4709-ba70-a198e4d1f72a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:42.535409 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-438eb401-ca1d-4709-ba70-a198e4d1f72a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:42.536308 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-438eb401-ca1d-4709-ba70-a198e4d1f72a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:42.623048 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-438eb401-ca1d-4709-ba70-a198e4d1f72a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:42.633712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-438eb401-ca1d-4709-ba70-a198e4d1f72a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1226 microversion: 2.1 time: 0.127871 Dec 13 16:49:42.636940 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 89/184] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:42 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1226 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:43.515546 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c43dcdb8-1596-44d8-9538-00b3076225b7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:43.516628 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c43dcdb8-1596-44d8-9538-00b3076225b7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:43.525173 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c43dcdb8-1596-44d8-9538-00b3076225b7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:43.525865 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c43dcdb8-1596-44d8-9538-00b3076225b7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:43.527103 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c43dcdb8-1596-44d8-9538-00b3076225b7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:43.527782 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c43dcdb8-1596-44d8-9538-00b3076225b7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:43.539812 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a7eb2788-ccca-4c87-93cf-af8699d2d28c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:43.541966 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a7eb2788-ccca-4c87-93cf-af8699d2d28c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:43.548518 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a7eb2788-ccca-4c87-93cf-af8699d2d28c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:43.549038 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a7eb2788-ccca-4c87-93cf-af8699d2d28c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:43.549911 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a7eb2788-ccca-4c87-93cf-af8699d2d28c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:43.550427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a7eb2788-ccca-4c87-93cf-af8699d2d28c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:45.925148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a7eb2788-ccca-4c87-93cf-af8699d2d28c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28173 microversion: 2.1 time: 2.389850 Dec 13 16:49:45.933052 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 90/185] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:43 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28173 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:45.941198 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0618b18f-eecc-4e65-8d6d-e262474768d0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:45.941488 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c43dcdb8-1596-44d8-9538-00b3076225b7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 28266 microversion: 2.20 time: 2.429783 Dec 13 16:49:45.942040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0618b18f-eecc-4e65-8d6d-e262474768d0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:45.943339 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 96/186] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:43 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 28266 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:49:45.957042 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0618b18f-eecc-4e65-8d6d-e262474768d0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:45.958162 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0618b18f-eecc-4e65-8d6d-e262474768d0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:45.959369 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0618b18f-eecc-4e65-8d6d-e262474768d0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:45.960163 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0618b18f-eecc-4e65-8d6d-e262474768d0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:46.174288 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0618b18f-eecc-4e65-8d6d-e262474768d0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:46.188213 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0618b18f-eecc-4e65-8d6d-e262474768d0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1274 microversion: 2.1 time: 0.253527 Dec 13 16:49:46.188993 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 91/187] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:45 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1274 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:46.940298 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0f64aec1-fb7e-467c-bce3-ae0e3e7df974 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:46.941554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0f64aec1-fb7e-467c-bce3-ae0e3e7df974 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:46.954631 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-52e431f4-f767-4ae9-acf6-d67194854565 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:46.955834 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-52e431f4-f767-4ae9-acf6-d67194854565 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:46.957072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0f64aec1-fb7e-467c-bce3-ae0e3e7df974 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:46.957765 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0f64aec1-fb7e-467c-bce3-ae0e3e7df974 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:46.958822 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0f64aec1-fb7e-467c-bce3-ae0e3e7df974 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:46.959596 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0f64aec1-fb7e-467c-bce3-ae0e3e7df974 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:46.980260 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-52e431f4-f767-4ae9-acf6-d67194854565 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:46.984716 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-52e431f4-f767-4ae9-acf6-d67194854565 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:46.988788 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-52e431f4-f767-4ae9-acf6-d67194854565 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:46.990068 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-52e431f4-f767-4ae9-acf6-d67194854565 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:47.037862 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0f64aec1-fb7e-467c-bce3-ae0e3e7df974 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28173 microversion: 2.1 time: 0.101906 Dec 13 16:49:47.043257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 97/188] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:46 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28173 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:47.074220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-52e431f4-f767-4ae9-acf6-d67194854565 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 28266 microversion: 2.20 time: 0.123492 Dec 13 16:49:47.074888 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 92/189] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:46 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 28266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:47.207458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8601634f-1887-43e6-87fe-300c16540092 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:47.208616 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8601634f-1887-43e6-87fe-300c16540092 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:47.217428 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8601634f-1887-43e6-87fe-300c16540092 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:47.218228 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8601634f-1887-43e6-87fe-300c16540092 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:47.219159 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8601634f-1887-43e6-87fe-300c16540092 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:47.219635 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8601634f-1887-43e6-87fe-300c16540092 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:47.302464 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8601634f-1887-43e6-87fe-300c16540092 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:47.314534 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8601634f-1887-43e6-87fe-300c16540092 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1280 microversion: 2.1 time: 0.111212 Dec 13 16:49:47.315762 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 98/190] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:47 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1280 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:47.904439 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-d8ab7608-13a9-4d4d-9520-07104752c40d req-30192fe5-dc12-40b5-9045-d0a2ed0511d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b8c803-5f08-441b-818f-a12f51820ff6", "tag": "b4f82f85-2cbf-4114-b796-a84807314de2"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:47.905962 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:47.905962 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:49:47.914746 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-d8ab7608-13a9-4d4d-9520-07104752c40d req-30192fe5-dc12-40b5-9045-d0a2ed0511d6 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:47.915461 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-d8ab7608-13a9-4d4d-9520-07104752c40d req-30192fe5-dc12-40b5-9045-d0a2ed0511d6 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:47.927684 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-d8ab7608-13a9-4d4d-9520-07104752c40d req-30192fe5-dc12-40b5-9045-d0a2ed0511d6 service nova] Creating event network-changed:b4f82f85-2cbf-4114-b796-a84807314de2 for instance 93b8c803-5f08-441b-818f-a12f51820ff6 on hv-cinder-82160 Dec 13 16:49:47.933887 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-d8ab7608-13a9-4d4d-9520-07104752c40d req-30192fe5-dc12-40b5-9045-d0a2ed0511d6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037470 Dec 13 16:49:47.934475 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 93/191] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:48.050796 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e11f29a0-4bbf-4488-9971-d6995a54f8ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:48.052475 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e11f29a0-4bbf-4488-9971-d6995a54f8ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:48.062267 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e11f29a0-4bbf-4488-9971-d6995a54f8ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:48.063062 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e11f29a0-4bbf-4488-9971-d6995a54f8ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:48.064063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e11f29a0-4bbf-4488-9971-d6995a54f8ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:48.064937 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e11f29a0-4bbf-4488-9971-d6995a54f8ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:48.090204 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a94a87c2-643c-439e-af69-2542b157f2e8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:48.091965 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a94a87c2-643c-439e-af69-2542b157f2e8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:48.106391 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a94a87c2-643c-439e-af69-2542b157f2e8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:48.108490 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a94a87c2-643c-439e-af69-2542b157f2e8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:48.109407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a94a87c2-643c-439e-af69-2542b157f2e8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:48.109823 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a94a87c2-643c-439e-af69-2542b157f2e8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:50.297358 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e11f29a0-4bbf-4488-9971-d6995a54f8ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28173 microversion: 2.1 time: 2.251429 Dec 13 16:49:50.302904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 99/192] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:48 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28173 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:49:50.303346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a94a87c2-643c-439e-af69-2542b157f2e8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 28266 microversion: 2.20 time: 2.218007 Dec 13 16:49:50.304628 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 94/193] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:48 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 28266 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:49:50.309297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-78e64299-5779-4b11-911d-b080a97f9b76 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:50.310111 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-78e64299-5779-4b11-911d-b080a97f9b76 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:50.310438 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-77e850a1-0c00-43e5-981b-397c242741b2 req-49867801-b7d6-4d57-b03a-8b6592914d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a3c922-a3b0-41ee-9726-aa3a38dd5143", "tag": "7a766edc-50c5-4f38-bfbd-5f1cb04e48a8"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:50.312120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:50.312120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:49:50.321849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-78e64299-5779-4b11-911d-b080a97f9b76 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:50.322283 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-78e64299-5779-4b11-911d-b080a97f9b76 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:50.325460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-77e850a1-0c00-43e5-981b-397c242741b2 req-49867801-b7d6-4d57-b03a-8b6592914d33 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:50.325614 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-78e64299-5779-4b11-911d-b080a97f9b76 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:50.326088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-78e64299-5779-4b11-911d-b080a97f9b76 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:50.326441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-77e850a1-0c00-43e5-981b-397c242741b2 req-49867801-b7d6-4d57-b03a-8b6592914d33 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:50.339967 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-77e850a1-0c00-43e5-981b-397c242741b2 req-49867801-b7d6-4d57-b03a-8b6592914d33 service nova] Creating event network-changed:7a766edc-50c5-4f38-bfbd-5f1cb04e48a8 for instance a9a3c922-a3b0-41ee-9726-aa3a38dd5143 on hv-cinder-82160 Dec 13 16:49:50.345091 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-77e850a1-0c00-43e5-981b-397c242741b2 req-49867801-b7d6-4d57-b03a-8b6592914d33 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038961 Dec 13 16:49:50.345895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 95/194] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:50.663196 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-78e64299-5779-4b11-911d-b080a97f9b76 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:50.685910 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-78e64299-5779-4b11-911d-b080a97f9b76 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1322 microversion: 2.1 time: 0.374584 Dec 13 16:49:50.692176 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 100/195] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:50 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:51.315419 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a1f2db6f-09cf-4d56-a7de-df92aaabb16a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:51.317121 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-23d3aaec-e73b-4f31-8ecf-90d4853d1730 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:51.318088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-23d3aaec-e73b-4f31-8ecf-90d4853d1730 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:51.324938 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a1f2db6f-09cf-4d56-a7de-df92aaabb16a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:51.332742 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-23d3aaec-e73b-4f31-8ecf-90d4853d1730 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:51.333485 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-23d3aaec-e73b-4f31-8ecf-90d4853d1730 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:51.334460 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-23d3aaec-e73b-4f31-8ecf-90d4853d1730 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:51.335065 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-23d3aaec-e73b-4f31-8ecf-90d4853d1730 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:51.343712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a1f2db6f-09cf-4d56-a7de-df92aaabb16a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:51.344168 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a1f2db6f-09cf-4d56-a7de-df92aaabb16a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:51.345087 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a1f2db6f-09cf-4d56-a7de-df92aaabb16a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:51.345677 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a1f2db6f-09cf-4d56-a7de-df92aaabb16a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:51.434772 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-23d3aaec-e73b-4f31-8ecf-90d4853d1730 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 28557 microversion: 2.20 time: 0.123064 Dec 13 16:49:51.435419 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 101/196] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:51 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 28557 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:49:51.463567 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a1f2db6f-09cf-4d56-a7de-df92aaabb16a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28464 microversion: 2.1 time: 0.155904 Dec 13 16:49:51.464462 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 96/197] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:51 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:51.706782 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b72ac24e-1497-4191-bf75-f1f17f7f8b0c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:51.707438 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b72ac24e-1497-4191-bf75-f1f17f7f8b0c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:51.714947 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b72ac24e-1497-4191-bf75-f1f17f7f8b0c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:51.715448 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b72ac24e-1497-4191-bf75-f1f17f7f8b0c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:51.716265 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b72ac24e-1497-4191-bf75-f1f17f7f8b0c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:51.716813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b72ac24e-1497-4191-bf75-f1f17f7f8b0c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:51.901118 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b72ac24e-1497-4191-bf75-f1f17f7f8b0c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:51.909948 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b72ac24e-1497-4191-bf75-f1f17f7f8b0c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1322 microversion: 2.1 time: 0.207365 Dec 13 16:49:51.910655 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 102/198] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:51 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:52.447357 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4fbdf394-8d52-41b7-9264-7abb046ae2ef tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:52.448350 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4fbdf394-8d52-41b7-9264-7abb046ae2ef tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:52.456049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4fbdf394-8d52-41b7-9264-7abb046ae2ef tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:52.456049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4fbdf394-8d52-41b7-9264-7abb046ae2ef tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:52.456799 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4fbdf394-8d52-41b7-9264-7abb046ae2ef tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:52.457252 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4fbdf394-8d52-41b7-9264-7abb046ae2ef tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:52.477261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d14a58f0-19e3-4a75-bef9-d757af682a4b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:52.478262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d14a58f0-19e3-4a75-bef9-d757af682a4b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:52.486873 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d14a58f0-19e3-4a75-bef9-d757af682a4b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:52.486873 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d14a58f0-19e3-4a75-bef9-d757af682a4b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:52.487355 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d14a58f0-19e3-4a75-bef9-d757af682a4b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:52.488018 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d14a58f0-19e3-4a75-bef9-d757af682a4b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:52.538533 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4fbdf394-8d52-41b7-9264-7abb046ae2ef tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 28697 microversion: 2.20 time: 0.094961 Dec 13 16:49:52.539193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 97/199] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:52 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 28697 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:52.584970 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d14a58f0-19e3-4a75-bef9-d757af682a4b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28515 microversion: 2.1 time: 0.111306 Dec 13 16:49:52.585704 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 103/200] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:52 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28515 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:49:52.928717 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9a0b8c07-72d4-474e-a427-a9b8a7a4f426 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:52.929426 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9a0b8c07-72d4-474e-a427-a9b8a7a4f426 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:52.937089 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9a0b8c07-72d4-474e-a427-a9b8a7a4f426 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:52.937528 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9a0b8c07-72d4-474e-a427-a9b8a7a4f426 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:52.938301 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9a0b8c07-72d4-474e-a427-a9b8a7a4f426 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:52.938739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9a0b8c07-72d4-474e-a427-a9b8a7a4f426 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:53.123076 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9a0b8c07-72d4-474e-a427-a9b8a7a4f426 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:53.131233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9a0b8c07-72d4-474e-a427-a9b8a7a4f426 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1322 microversion: 2.1 time: 0.208135 Dec 13 16:49:53.131815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 98/201] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:52 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:53.554668 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-77a91106-aba5-4404-bb3e-6388ccb9f606 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:53.557436 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-77a91106-aba5-4404-bb3e-6388ccb9f606 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:53.580590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-77a91106-aba5-4404-bb3e-6388ccb9f606 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:53.581718 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-77a91106-aba5-4404-bb3e-6388ccb9f606 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:53.583501 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-77a91106-aba5-4404-bb3e-6388ccb9f606 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:53.584387 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-77a91106-aba5-4404-bb3e-6388ccb9f606 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:53.597796 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1777ad0e-8511-4e4d-bb3f-98d968a2971d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:53.598769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1777ad0e-8511-4e4d-bb3f-98d968a2971d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:53.610904 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1777ad0e-8511-4e4d-bb3f-98d968a2971d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:53.611356 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1777ad0e-8511-4e4d-bb3f-98d968a2971d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:53.612209 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1777ad0e-8511-4e4d-bb3f-98d968a2971d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:53.617084 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1777ad0e-8511-4e4d-bb3f-98d968a2971d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:53.729590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-77a91106-aba5-4404-bb3e-6388ccb9f606 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 28725 microversion: 2.20 time: 0.182894 Dec 13 16:49:53.732655 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 104/202] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:53 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 28725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:53.748934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1777ad0e-8511-4e4d-bb3f-98d968a2971d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28632 microversion: 2.1 time: 0.154745 Dec 13 16:49:53.749815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 99/203] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:53 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28632 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:54.149239 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f4561e19-d93d-4e62-90d1-0de2346c9697 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:54.150320 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f4561e19-d93d-4e62-90d1-0de2346c9697 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:54.170714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4561e19-d93d-4e62-90d1-0de2346c9697 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:54.171389 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4561e19-d93d-4e62-90d1-0de2346c9697 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:54.172854 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4561e19-d93d-4e62-90d1-0de2346c9697 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:54.173408 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4561e19-d93d-4e62-90d1-0de2346c9697 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:54.346066 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f4561e19-d93d-4e62-90d1-0de2346c9697 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:54.354615 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f4561e19-d93d-4e62-90d1-0de2346c9697 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1322 microversion: 2.1 time: 0.209854 Dec 13 16:49:54.355212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 105/204] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:54 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:54.743598 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2c976f9b-a977-4ddc-b600-bbc8c091aeff tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:54.744666 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-2c976f9b-a977-4ddc-b600-bbc8c091aeff tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:54.752334 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2c976f9b-a977-4ddc-b600-bbc8c091aeff tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:54.752814 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2c976f9b-a977-4ddc-b600-bbc8c091aeff tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:54.753625 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2c976f9b-a977-4ddc-b600-bbc8c091aeff tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:54.754049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2c976f9b-a977-4ddc-b600-bbc8c091aeff tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:54.762149 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-729c6f64-ba60-4839-97e3-2f3fa89ac3d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:54.763053 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-729c6f64-ba60-4839-97e3-2f3fa89ac3d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:54.769752 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-729c6f64-ba60-4839-97e3-2f3fa89ac3d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:54.770191 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-729c6f64-ba60-4839-97e3-2f3fa89ac3d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:54.770991 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-729c6f64-ba60-4839-97e3-2f3fa89ac3d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:54.771420 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-729c6f64-ba60-4839-97e3-2f3fa89ac3d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:54.828220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2c976f9b-a977-4ddc-b600-bbc8c091aeff tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 28725 microversion: 2.20 time: 0.088596 Dec 13 16:49:54.828909 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 100/205] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:54 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 28725 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:54.846327 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-729c6f64-ba60-4839-97e3-2f3fa89ac3d7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28632 microversion: 2.1 time: 0.087718 Dec 13 16:49:54.847241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 106/206] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:54 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28632 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:55.378339 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3e32bd37-24f4-4182-9a32-c160cf2bea2c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:55.379353 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3e32bd37-24f4-4182-9a32-c160cf2bea2c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:55.387474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3e32bd37-24f4-4182-9a32-c160cf2bea2c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:55.387995 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3e32bd37-24f4-4182-9a32-c160cf2bea2c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:55.389091 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3e32bd37-24f4-4182-9a32-c160cf2bea2c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:55.389516 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3e32bd37-24f4-4182-9a32-c160cf2bea2c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:55.565470 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-b3c764ae-12f7-4d52-ae69-5a62907180a1 req-8666e078-7ea8-463d-8012-d582d9a96a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b8c803-5f08-441b-818f-a12f51820ff6", "name": "network-vif-plugged", "status": "completed", "tag": "b4f82f85-2cbf-4114-b796-a84807314de2"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:55.568105 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:55.568105 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:49:55.590077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b3c764ae-12f7-4d52-ae69-5a62907180a1 req-8666e078-7ea8-463d-8012-d582d9a96a60 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:55.591993 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b3c764ae-12f7-4d52-ae69-5a62907180a1 req-8666e078-7ea8-463d-8012-d582d9a96a60 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:55.619092 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3e32bd37-24f4-4182-9a32-c160cf2bea2c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:55.643355 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3e32bd37-24f4-4182-9a32-c160cf2bea2c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1322 microversion: 2.1 time: 0.269048 Dec 13 16:49:55.644001 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-b3c764ae-12f7-4d52-ae69-5a62907180a1 req-8666e078-7ea8-463d-8012-d582d9a96a60 service nova] Creating event network-vif-plugged:b4f82f85-2cbf-4114-b796-a84807314de2 for instance 93b8c803-5f08-441b-818f-a12f51820ff6 on hv-cinder-82160 Dec 13 16:49:55.645831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 101/207] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:55 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:55.656505 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-b3c764ae-12f7-4d52-ae69-5a62907180a1 req-8666e078-7ea8-463d-8012-d582d9a96a60 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098022 Dec 13 16:49:55.658642 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 107/208] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:55.846323 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5b38ceb3-48e1-43a7-a221-0ecda741a64b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:55.848202 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5b38ceb3-48e1-43a7-a221-0ecda741a64b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:55.864906 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-05f415f9-3dce-41e3-8d5a-3dce2bd36528 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:55.882813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-05f415f9-3dce-41e3-8d5a-3dce2bd36528 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:55.896390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5b38ceb3-48e1-43a7-a221-0ecda741a64b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:55.896519 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5b38ceb3-48e1-43a7-a221-0ecda741a64b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:55.903206 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5b38ceb3-48e1-43a7-a221-0ecda741a64b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:55.904992 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5b38ceb3-48e1-43a7-a221-0ecda741a64b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:55.911878 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05f415f9-3dce-41e3-8d5a-3dce2bd36528 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:55.912601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05f415f9-3dce-41e3-8d5a-3dce2bd36528 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:55.913971 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05f415f9-3dce-41e3-8d5a-3dce2bd36528 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:55.914620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05f415f9-3dce-41e3-8d5a-3dce2bd36528 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:56.278848 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5b38ceb3-48e1-43a7-a221-0ecda741a64b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 28725 microversion: 2.20 time: 0.441274 Dec 13 16:49:56.279836 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 102/209] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:55 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 28725 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:56.294832 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-05f415f9-3dce-41e3-8d5a-3dce2bd36528 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28632 microversion: 2.1 time: 0.439030 Dec 13 16:49:56.297660 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 108/210] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:55 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28632 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:49:56.677838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-097e19ce-a198-4aee-a0da-2c2a250509eb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:56.678540 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-097e19ce-a198-4aee-a0da-2c2a250509eb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:56.685888 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-097e19ce-a198-4aee-a0da-2c2a250509eb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:56.686570 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-097e19ce-a198-4aee-a0da-2c2a250509eb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:56.687353 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-097e19ce-a198-4aee-a0da-2c2a250509eb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:56.687786 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-097e19ce-a198-4aee-a0da-2c2a250509eb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:56.850999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-097e19ce-a198-4aee-a0da-2c2a250509eb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:56.860536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-097e19ce-a198-4aee-a0da-2c2a250509eb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1322 microversion: 2.1 time: 0.187954 Dec 13 16:49:56.861553 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 103/211] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:56 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:57.291982 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4c7bb24a-38b3-49f6-a0b1-e19330161875 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:57.293014 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4c7bb24a-38b3-49f6-a0b1-e19330161875 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:57.300073 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4c7bb24a-38b3-49f6-a0b1-e19330161875 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:57.300518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4c7bb24a-38b3-49f6-a0b1-e19330161875 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:57.310834 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4c7bb24a-38b3-49f6-a0b1-e19330161875 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:57.311287 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4c7bb24a-38b3-49f6-a0b1-e19330161875 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:57.318946 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7c3f367f-a3ab-4ef8-8962-071ef1b0fb3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:57.319892 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7c3f367f-a3ab-4ef8-8962-071ef1b0fb3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:57.336329 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7c3f367f-a3ab-4ef8-8962-071ef1b0fb3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:57.337070 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7c3f367f-a3ab-4ef8-8962-071ef1b0fb3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:57.341264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7c3f367f-a3ab-4ef8-8962-071ef1b0fb3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:57.342547 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7c3f367f-a3ab-4ef8-8962-071ef1b0fb3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:57.442426 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4c7bb24a-38b3-49f6-a0b1-e19330161875 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 29650 microversion: 2.20 time: 0.154410 Dec 13 16:49:57.443083 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 109/212] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:57 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 29650 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:57.470972 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7c3f367f-a3ab-4ef8-8962-071ef1b0fb3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 28784 microversion: 2.1 time: 0.167105 Dec 13 16:49:57.472121 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 104/213] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:57 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 28784 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:49:57.880747 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a330e0b8-53a7-485e-a197-237fa1318d40 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:57.881706 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a330e0b8-53a7-485e-a197-237fa1318d40 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:57.883882 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-cd3e8cd8-f6e6-4e75-9eca-bedc9fb573c3 req-b0e3bf2d-82d1-4168-ac3c-5849c14f8921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a3c922-a3b0-41ee-9726-aa3a38dd5143", "name": "network-vif-plugged", "status": "completed", "tag": "7a766edc-50c5-4f38-bfbd-5f1cb04e48a8"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:57.886566 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:49:57.886566 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:49:57.898080 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-cd3e8cd8-f6e6-4e75-9eca-bedc9fb573c3 req-b0e3bf2d-82d1-4168-ac3c-5849c14f8921 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:57.899001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-cd3e8cd8-f6e6-4e75-9eca-bedc9fb573c3 req-b0e3bf2d-82d1-4168-ac3c-5849c14f8921 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:57.899558 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a330e0b8-53a7-485e-a197-237fa1318d40 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:57.900017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a330e0b8-53a7-485e-a197-237fa1318d40 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:57.901898 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a330e0b8-53a7-485e-a197-237fa1318d40 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:57.903571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a330e0b8-53a7-485e-a197-237fa1318d40 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:57.917828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-cd3e8cd8-f6e6-4e75-9eca-bedc9fb573c3 req-b0e3bf2d-82d1-4168-ac3c-5849c14f8921 service nova] Creating event network-vif-plugged:7a766edc-50c5-4f38-bfbd-5f1cb04e48a8 for instance a9a3c922-a3b0-41ee-9726-aa3a38dd5143 on hv-cinder-82160 Dec 13 16:49:57.923904 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-cd3e8cd8-f6e6-4e75-9eca-bedc9fb573c3 req-b0e3bf2d-82d1-4168-ac3c-5849c14f8921 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046445 Dec 13 16:49:57.925367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 105/214] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:49:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:49:58.383528 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a330e0b8-53a7-485e-a197-237fa1318d40 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:58.394233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a330e0b8-53a7-485e-a197-237fa1318d40 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1322 microversion: 2.1 time: 0.519320 Dec 13 16:49:58.395144 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 110/215] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:57 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:58.455255 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-cc873700-2444-4aae-829e-264bdcc885ba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:58.456907 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-cc873700-2444-4aae-829e-264bdcc885ba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:58.463531 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cc873700-2444-4aae-829e-264bdcc885ba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:58.463989 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cc873700-2444-4aae-829e-264bdcc885ba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:58.464912 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cc873700-2444-4aae-829e-264bdcc885ba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:58.465521 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cc873700-2444-4aae-829e-264bdcc885ba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:58.482338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b76f4648-ef16-4e3a-b311-c7e73bf07f51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:58.483529 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b76f4648-ef16-4e3a-b311-c7e73bf07f51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:58.491816 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b76f4648-ef16-4e3a-b311-c7e73bf07f51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:58.492260 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b76f4648-ef16-4e3a-b311-c7e73bf07f51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:58.493075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b76f4648-ef16-4e3a-b311-c7e73bf07f51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:58.493503 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b76f4648-ef16-4e3a-b311-c7e73bf07f51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:58.716827 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-cc873700-2444-4aae-829e-264bdcc885ba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 31430 microversion: 2.20 time: 0.265311 Dec 13 16:49:58.719062 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 106/216] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:58 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 31430 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:49:58.756363 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b76f4648-ef16-4e3a-b311-c7e73bf07f51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 30589 microversion: 2.1 time: 0.277490 Dec 13 16:49:58.758124 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 111/217] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:58 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 30589 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:49:59.411773 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e0bd2309-246b-4db2-86f6-d7baa6ff6505 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:49:59.412470 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e0bd2309-246b-4db2-86f6-d7baa6ff6505 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:59.420051 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e0bd2309-246b-4db2-86f6-d7baa6ff6505 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:59.420635 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e0bd2309-246b-4db2-86f6-d7baa6ff6505 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:59.422224 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e0bd2309-246b-4db2-86f6-d7baa6ff6505 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:59.423240 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e0bd2309-246b-4db2-86f6-d7baa6ff6505 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:59.586357 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e0bd2309-246b-4db2-86f6-d7baa6ff6505 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:49:59.593927 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e0bd2309-246b-4db2-86f6-d7baa6ff6505 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1322 microversion: 2.1 time: 0.186460 Dec 13 16:49:59.594455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 107/218] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:49:59 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:49:59.730213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d18d4db3-6297-4133-9ccc-185f17f992b3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:59.731436 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d18d4db3-6297-4133-9ccc-185f17f992b3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:59.739615 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d18d4db3-6297-4133-9ccc-185f17f992b3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:59.740212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d18d4db3-6297-4133-9ccc-185f17f992b3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:59.741694 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d18d4db3-6297-4133-9ccc-185f17f992b3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:59.742287 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d18d4db3-6297-4133-9ccc-185f17f992b3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:59.770842 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8b5b94f9-215d-4706-9a23-b14df17bdc21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:49:59.771889 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8b5b94f9-215d-4706-9a23-b14df17bdc21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:49:59.786232 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b5b94f9-215d-4706-9a23-b14df17bdc21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:59.786669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b5b94f9-215d-4706-9a23-b14df17bdc21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:59.787428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b5b94f9-215d-4706-9a23-b14df17bdc21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:49:59.787864 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b5b94f9-215d-4706-9a23-b14df17bdc21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:49:59.857487 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d18d4db3-6297-4133-9ccc-185f17f992b3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 32595 microversion: 2.20 time: 0.131424 Dec 13 16:49:59.858296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 112/219] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:49:59 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 32595 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:49:59.889459 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8b5b94f9-215d-4706-9a23-b14df17bdc21 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 31893 microversion: 2.1 time: 0.122973 Dec 13 16:49:59.890340 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 108/220] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:49:59 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 31893 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:50:00.613174 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d9365a12-c0a0-4a89-a2e9-9d98c7974ee1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:00.613863 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d9365a12-c0a0-4a89-a2e9-9d98c7974ee1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:00.625804 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d9365a12-c0a0-4a89-a2e9-9d98c7974ee1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:00.626440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d9365a12-c0a0-4a89-a2e9-9d98c7974ee1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:00.627232 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d9365a12-c0a0-4a89-a2e9-9d98c7974ee1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:00.627734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d9365a12-c0a0-4a89-a2e9-9d98c7974ee1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:00.776773 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d9365a12-c0a0-4a89-a2e9-9d98c7974ee1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:00.784993 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d9365a12-c0a0-4a89-a2e9-9d98c7974ee1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1516 microversion: 2.1 time: 0.176791 Dec 13 16:50:00.785586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 113/221] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:00 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:00.802500 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f8742d6a-ba2e-4f44-871f-f1c1423f5b2b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:00.803536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f8742d6a-ba2e-4f44-871f-f1c1423f5b2b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:00.810620 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f8742d6a-ba2e-4f44-871f-f1c1423f5b2b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:00.811077 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f8742d6a-ba2e-4f44-871f-f1c1423f5b2b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:00.811924 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f8742d6a-ba2e-4f44-871f-f1c1423f5b2b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:00.812361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f8742d6a-ba2e-4f44-871f-f1c1423f5b2b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:00.839648 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-f8742d6a-ba2e-4f44-871f-f1c1423f5b2b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lazy-loading 'flavor' on Instance uuid a9a3c922-a3b0-41ee-9726-aa3a38dd5143 {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:50:00.870693 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9ac123e2-b45b-476b-bffc-d6a6f77a7b69 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:00.871836 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9ac123e2-b45b-476b-bffc-d6a6f77a7b69 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:00.878318 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9ac123e2-b45b-476b-bffc-d6a6f77a7b69 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:00.878727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9ac123e2-b45b-476b-bffc-d6a6f77a7b69 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:00.879710 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9ac123e2-b45b-476b-bffc-d6a6f77a7b69 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:00.880138 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9ac123e2-b45b-476b-bffc-d6a6f77a7b69 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:00.961386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f8742d6a-ba2e-4f44-871f-f1c1423f5b2b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143/action" status: 200 len: 32 microversion: 2.1 time: 0.163277 Dec 13 16:50:00.961991 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 109/222] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:00 2021] POST /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:50:00.967667 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-59136e0f-9e2f-4143-a4ff-d03aeec65d27 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:00.968834 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-59136e0f-9e2f-4143-a4ff-d03aeec65d27 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:00.978686 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59136e0f-9e2f-4143-a4ff-d03aeec65d27 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:00.979133 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59136e0f-9e2f-4143-a4ff-d03aeec65d27 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:00.979930 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59136e0f-9e2f-4143-a4ff-d03aeec65d27 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:00.980563 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59136e0f-9e2f-4143-a4ff-d03aeec65d27 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:00.989837 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9ac123e2-b45b-476b-bffc-d6a6f77a7b69 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 33422 microversion: 2.20 time: 0.123409 Dec 13 16:50:00.990874 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 114/223] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:00 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 33422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:50:00.997641 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a8aa8de5-a5b5-4686-a1e5-472ff298a66e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:00.999231 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a8aa8de5-a5b5-4686-a1e5-472ff298a66e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:01.010246 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a8aa8de5-a5b5-4686-a1e5-472ff298a66e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:01.010805 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a8aa8de5-a5b5-4686-a1e5-472ff298a66e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:01.011719 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a8aa8de5-a5b5-4686-a1e5-472ff298a66e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:01.012215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a8aa8de5-a5b5-4686-a1e5-472ff298a66e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:01.080931 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-59136e0f-9e2f-4143-a4ff-d03aeec65d27 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 33033 microversion: 2.1 time: 0.117400 Dec 13 16:50:01.082087 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 110/224] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:00 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 33033 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:50:01.269063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a8aa8de5-a5b5-4686-a1e5-472ff298a66e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:01.277468 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a8aa8de5-a5b5-4686-a1e5-472ff298a66e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.284870 Dec 13 16:50:01.288658 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 115/225] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:00 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:02.003896 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e0953153-51e3-4d12-87cf-70a7bda43743 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:02.005067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e0953153-51e3-4d12-87cf-70a7bda43743 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:02.012367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e0953153-51e3-4d12-87cf-70a7bda43743 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:02.012848 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e0953153-51e3-4d12-87cf-70a7bda43743 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:02.013626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e0953153-51e3-4d12-87cf-70a7bda43743 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:02.014056 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e0953153-51e3-4d12-87cf-70a7bda43743 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:02.094476 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-42ff0938-38dd-4f66-a671-b52989556620 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:02.095777 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-42ff0938-38dd-4f66-a671-b52989556620 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:02.102674 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42ff0938-38dd-4f66-a671-b52989556620 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:02.103124 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42ff0938-38dd-4f66-a671-b52989556620 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:02.103949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42ff0938-38dd-4f66-a671-b52989556620 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:02.104382 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42ff0938-38dd-4f66-a671-b52989556620 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:02.110217 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e0953153-51e3-4d12-87cf-70a7bda43743 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 34060 microversion: 2.20 time: 0.110520 Dec 13 16:50:02.110965 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 111/226] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:01 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 34060 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:50:02.182152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-42ff0938-38dd-4f66-a671-b52989556620 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 33742 microversion: 2.1 time: 0.091161 Dec 13 16:50:02.182895 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 116/227] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:02 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 33742 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:50:02.296083 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bfcc3c95-7801-4c94-b89a-0ab92281d986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:02.296731 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bfcc3c95-7801-4c94-b89a-0ab92281d986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:02.304731 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfcc3c95-7801-4c94-b89a-0ab92281d986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:02.305189 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfcc3c95-7801-4c94-b89a-0ab92281d986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:02.305986 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfcc3c95-7801-4c94-b89a-0ab92281d986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:02.306421 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfcc3c95-7801-4c94-b89a-0ab92281d986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:02.469991 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bfcc3c95-7801-4c94-b89a-0ab92281d986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:02.478204 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bfcc3c95-7801-4c94-b89a-0ab92281d986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.186266 Dec 13 16:50:02.479078 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 112/228] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:02 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:03.124157 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-dd2b6381-e45f-4df8-8dba-9084032f1ccc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:03.125244 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-dd2b6381-e45f-4df8-8dba-9084032f1ccc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:03.132688 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dd2b6381-e45f-4df8-8dba-9084032f1ccc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:03.133133 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dd2b6381-e45f-4df8-8dba-9084032f1ccc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:03.133918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dd2b6381-e45f-4df8-8dba-9084032f1ccc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:03.134343 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dd2b6381-e45f-4df8-8dba-9084032f1ccc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:03.194804 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5af8d0be-6fc8-4b66-a3de-8dc1fd056964 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:03.195713 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5af8d0be-6fc8-4b66-a3de-8dc1fd056964 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:03.202294 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5af8d0be-6fc8-4b66-a3de-8dc1fd056964 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:03.202738 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5af8d0be-6fc8-4b66-a3de-8dc1fd056964 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:03.203598 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5af8d0be-6fc8-4b66-a3de-8dc1fd056964 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:03.204033 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5af8d0be-6fc8-4b66-a3de-8dc1fd056964 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:06.184209 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-dd2b6381-e45f-4df8-8dba-9084032f1ccc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 35907 microversion: 2.20 time: 3.064318 Dec 13 16:50:06.184793 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 117/229] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:03 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 35907 bytes in 3066 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:50:06.189825 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a0787eab-8a6f-41cb-8fcd-09c1e4a310ce tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:06.190509 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a0787eab-8a6f-41cb-8fcd-09c1e4a310ce tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:06.198522 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a0787eab-8a6f-41cb-8fcd-09c1e4a310ce tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:06.198918 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5af8d0be-6fc8-4b66-a3de-8dc1fd056964 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 36547 microversion: 2.1 time: 3.007643 Dec 13 16:50:06.199390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a0787eab-8a6f-41cb-8fcd-09c1e4a310ce tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:06.203058 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a0787eab-8a6f-41cb-8fcd-09c1e4a310ce tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:06.203192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 113/230] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:03 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 36547 bytes in 3010 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:50:06.203312 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a0787eab-8a6f-41cb-8fcd-09c1e4a310ce tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:06.338902 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a0787eab-8a6f-41cb-8fcd-09c1e4a310ce tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:06.347352 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a0787eab-8a6f-41cb-8fcd-09c1e4a310ce tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.161405 Dec 13 16:50:06.347929 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 118/231] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:06 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:07.200965 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-16b65807-00f3-4d47-a596-08918252cdf8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:07.202147 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-16b65807-00f3-4d47-a596-08918252cdf8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:07.209829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-16b65807-00f3-4d47-a596-08918252cdf8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:07.210365 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-16b65807-00f3-4d47-a596-08918252cdf8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:07.210791 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ebff3ecf-2760-4dc9-a8b0-fb3712c439f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:07.211289 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-16b65807-00f3-4d47-a596-08918252cdf8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:07.211670 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ebff3ecf-2760-4dc9-a8b0-fb3712c439f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:07.211808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-16b65807-00f3-4d47-a596-08918252cdf8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:07.217962 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ebff3ecf-2760-4dc9-a8b0-fb3712c439f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:07.218401 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ebff3ecf-2760-4dc9-a8b0-fb3712c439f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:07.219175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ebff3ecf-2760-4dc9-a8b0-fb3712c439f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:07.219634 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ebff3ecf-2760-4dc9-a8b0-fb3712c439f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:07.297506 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-16b65807-00f3-4d47-a596-08918252cdf8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 36933 microversion: 2.20 time: 0.101308 Dec 13 16:50:07.298385 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 114/232] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:07 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 36933 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:50:07.313238 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ebff3ecf-2760-4dc9-a8b0-fb3712c439f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 37307 microversion: 2.1 time: 0.105899 Dec 13 16:50:07.314274 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 119/233] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:07 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 37307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:50:07.367142 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9804a297-6f9b-410f-a5e0-f85db915311d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:07.367826 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9804a297-6f9b-410f-a5e0-f85db915311d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:07.375075 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9804a297-6f9b-410f-a5e0-f85db915311d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:07.375518 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9804a297-6f9b-410f-a5e0-f85db915311d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:07.376691 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9804a297-6f9b-410f-a5e0-f85db915311d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:07.377383 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9804a297-6f9b-410f-a5e0-f85db915311d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:07.756017 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9804a297-6f9b-410f-a5e0-f85db915311d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:07.763619 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9804a297-6f9b-410f-a5e0-f85db915311d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.400532 Dec 13 16:50:07.764143 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 115/234] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:07 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:08.310305 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0d669096-78ee-4a48-8151-be41fd01097b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:08.311296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0d669096-78ee-4a48-8151-be41fd01097b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:08.318582 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0d669096-78ee-4a48-8151-be41fd01097b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:08.319026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0d669096-78ee-4a48-8151-be41fd01097b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:08.319796 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0d669096-78ee-4a48-8151-be41fd01097b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:08.320215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0d669096-78ee-4a48-8151-be41fd01097b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:08.326242 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3408e60e-773a-4c17-9fd1-572fc2b6e761 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:08.327275 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3408e60e-773a-4c17-9fd1-572fc2b6e761 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:08.335199 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3408e60e-773a-4c17-9fd1-572fc2b6e761 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:08.335616 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3408e60e-773a-4c17-9fd1-572fc2b6e761 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:08.336429 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3408e60e-773a-4c17-9fd1-572fc2b6e761 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:08.336902 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3408e60e-773a-4c17-9fd1-572fc2b6e761 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:08.404665 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0d669096-78ee-4a48-8151-be41fd01097b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 38006 microversion: 2.20 time: 0.098140 Dec 13 16:50:08.405257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 120/235] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:08 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 38006 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:50:08.440724 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3408e60e-773a-4c17-9fd1-572fc2b6e761 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 38146 microversion: 2.1 time: 0.118419 Dec 13 16:50:08.441694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 116/236] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:08 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 38146 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:50:08.781599 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-147fa076-364f-4694-a293-23b060ff7e91 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:08.782374 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-147fa076-364f-4694-a293-23b060ff7e91 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:08.789511 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-147fa076-364f-4694-a293-23b060ff7e91 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:08.789960 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-147fa076-364f-4694-a293-23b060ff7e91 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:08.790746 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-147fa076-364f-4694-a293-23b060ff7e91 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:08.791185 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-147fa076-364f-4694-a293-23b060ff7e91 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:08.935992 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-147fa076-364f-4694-a293-23b060ff7e91 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:08.944352 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-147fa076-364f-4694-a293-23b060ff7e91 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.166778 Dec 13 16:50:08.944981 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 121/237] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:08 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:09.417576 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-73f47e24-858f-4fe8-95d3-0486a14e554b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:09.418565 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-73f47e24-858f-4fe8-95d3-0486a14e554b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:09.425859 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73f47e24-858f-4fe8-95d3-0486a14e554b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:09.426300 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73f47e24-858f-4fe8-95d3-0486a14e554b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:09.427072 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73f47e24-858f-4fe8-95d3-0486a14e554b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:09.427494 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73f47e24-858f-4fe8-95d3-0486a14e554b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:09.451828 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4a2139a3-2578-4bc6-bf22-25df9bb68086 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:09.452768 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4a2139a3-2578-4bc6-bf22-25df9bb68086 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:09.462833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4a2139a3-2578-4bc6-bf22-25df9bb68086 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:09.463583 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4a2139a3-2578-4bc6-bf22-25df9bb68086 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:09.464945 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4a2139a3-2578-4bc6-bf22-25df9bb68086 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:09.465652 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4a2139a3-2578-4bc6-bf22-25df9bb68086 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:09.520598 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-73f47e24-858f-4fe8-95d3-0486a14e554b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 38273 microversion: 2.20 time: 0.107099 Dec 13 16:50:09.521410 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 117/238] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:09 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 38273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:50:09.552809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4a2139a3-2578-4bc6-bf22-25df9bb68086 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 38146 microversion: 2.1 time: 0.104381 Dec 13 16:50:09.553461 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 122/239] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:09 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 38146 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:50:09.962348 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6bbbfdfe-a43d-4555-acbf-779422ede627 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:09.963058 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6bbbfdfe-a43d-4555-acbf-779422ede627 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:09.970166 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6bbbfdfe-a43d-4555-acbf-779422ede627 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:09.970627 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6bbbfdfe-a43d-4555-acbf-779422ede627 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:09.971402 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6bbbfdfe-a43d-4555-acbf-779422ede627 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:09.971824 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6bbbfdfe-a43d-4555-acbf-779422ede627 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:10.122582 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6bbbfdfe-a43d-4555-acbf-779422ede627 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:10.130337 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6bbbfdfe-a43d-4555-acbf-779422ede627 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.172047 Dec 13 16:50:10.130899 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 118/240] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:09 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:10.538351 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c88c92d7-4467-4e2d-85ff-aceff14bef05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:10.539778 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c88c92d7-4467-4e2d-85ff-aceff14bef05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:10.548926 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c88c92d7-4467-4e2d-85ff-aceff14bef05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:10.549431 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c88c92d7-4467-4e2d-85ff-aceff14bef05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:10.550342 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c88c92d7-4467-4e2d-85ff-aceff14bef05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:10.550830 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c88c92d7-4467-4e2d-85ff-aceff14bef05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:10.567138 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-11bdc0fb-ec90-40bd-a390-576d22827c4e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:10.567138 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-11bdc0fb-ec90-40bd-a390-576d22827c4e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:10.574451 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-11bdc0fb-ec90-40bd-a390-576d22827c4e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:10.578001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-11bdc0fb-ec90-40bd-a390-576d22827c4e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:10.578967 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-11bdc0fb-ec90-40bd-a390-576d22827c4e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:10.579540 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-11bdc0fb-ec90-40bd-a390-576d22827c4e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:10.646127 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c88c92d7-4467-4e2d-85ff-aceff14bef05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 200 len: 38416 microversion: 2.20 time: 0.111795 Dec 13 16:50:10.646908 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 123/241] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:10 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 38416 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:50:10.657463 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3f75f65a-abe0-4101-829d-306e6bba00e5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:10.658220 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3f75f65a-abe0-4101-829d-306e6bba00e5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:10.661702 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-11bdc0fb-ec90-40bd-a390-576d22827c4e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 38146 microversion: 2.1 time: 0.100230 Dec 13 16:50:10.662397 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 119/242] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:10 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 38146 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:50:10.666381 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3f75f65a-abe0-4101-829d-306e6bba00e5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:10.666818 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3f75f65a-abe0-4101-829d-306e6bba00e5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:10.667604 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3f75f65a-abe0-4101-829d-306e6bba00e5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:10.668022 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3f75f65a-abe0-4101-829d-306e6bba00e5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:10.700016 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3f75f65a-abe0-4101-829d-306e6bba00e5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/ips" status: 200 len: 152 microversion: 2.20 time: 0.046763 Dec 13 16:50:10.700808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 124/243] 10.222.0.62 () {60 vars in 1288 bytes} [Mon Dec 13 16:50:10 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:50:11.148696 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-82c26389-7244-438d-a2d2-4f4ae34a3b59 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:11.149388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-82c26389-7244-438d-a2d2-4f4ae34a3b59 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:11.156627 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-82c26389-7244-438d-a2d2-4f4ae34a3b59 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:11.157077 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-82c26389-7244-438d-a2d2-4f4ae34a3b59 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:11.158448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-82c26389-7244-438d-a2d2-4f4ae34a3b59 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:11.158879 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-82c26389-7244-438d-a2d2-4f4ae34a3b59 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:11.306205 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-82c26389-7244-438d-a2d2-4f4ae34a3b59 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:11.318152 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-82c26389-7244-438d-a2d2-4f4ae34a3b59 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.173627 Dec 13 16:50:11.319365 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 120/244] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:11 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:11.717625 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a088cb7e-d4e2-485c-af13-4676c5a980e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:11.718871 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a088cb7e-d4e2-485c-af13-4676c5a980e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:11.726111 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a088cb7e-d4e2-485c-af13-4676c5a980e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:11.726761 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a088cb7e-d4e2-485c-af13-4676c5a980e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:11.727611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a088cb7e-d4e2-485c-af13-4676c5a980e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:11.728052 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a088cb7e-d4e2-485c-af13-4676c5a980e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:11.810211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a088cb7e-d4e2-485c-af13-4676c5a980e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 200 len: 38277 microversion: 2.1 time: 0.096306 Dec 13 16:50:11.812065 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 125/245] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:11 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 38277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:50:11.821452 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-39ca147d-6bd0-44b5-bfaf-c57ad0df64be tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:11.821939 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-39ca147d-6bd0-44b5-bfaf-c57ad0df64be tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:11.830157 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39ca147d-6bd0-44b5-bfaf-c57ad0df64be tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:11.830620 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39ca147d-6bd0-44b5-bfaf-c57ad0df64be tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:11.831432 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39ca147d-6bd0-44b5-bfaf-c57ad0df64be tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:11.831866 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39ca147d-6bd0-44b5-bfaf-c57ad0df64be tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:11.857105 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-39ca147d-6bd0-44b5-bfaf-c57ad0df64be tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/ips" status: 200 len: 145 microversion: 2.1 time: 0.039411 Dec 13 16:50:11.857703 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 121/246] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 13 16:50:11 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:50:12.336127 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5139510e-92d3-474b-9612-8807454eddd2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:12.336853 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5139510e-92d3-474b-9612-8807454eddd2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:12.344154 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5139510e-92d3-474b-9612-8807454eddd2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:12.344628 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5139510e-92d3-474b-9612-8807454eddd2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:12.345711 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5139510e-92d3-474b-9612-8807454eddd2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:12.346151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5139510e-92d3-474b-9612-8807454eddd2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:12.487496 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5139510e-92d3-474b-9612-8807454eddd2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:12.495496 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5139510e-92d3-474b-9612-8807454eddd2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.163640 Dec 13 16:50:12.496060 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 126/247] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:12 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:13.422889 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-980b28cb-ad27-4d3e-b8c9-89fbeb9cc7fc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:13.423787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-980b28cb-ad27-4d3e-b8c9-89fbeb9cc7fc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:13.430867 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-980b28cb-ad27-4d3e-b8c9-89fbeb9cc7fc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:13.431310 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-980b28cb-ad27-4d3e-b8c9-89fbeb9cc7fc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:13.432095 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-980b28cb-ad27-4d3e-b8c9-89fbeb9cc7fc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:13.432523 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-980b28cb-ad27-4d3e-b8c9-89fbeb9cc7fc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:13.457067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-980b28cb-ad27-4d3e-b8c9-89fbeb9cc7fc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lazy-loading 'flavor' on Instance uuid 49b9554f-cedc-4ce0-a3d7-c4be33ec154f {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:50:13.513435 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1a9e5b1d-e876-40f1-9dae-4afb19754f62 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:13.514122 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1a9e5b1d-e876-40f1-9dae-4afb19754f62 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:13.521148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1a9e5b1d-e876-40f1-9dae-4afb19754f62 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:13.521665 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1a9e5b1d-e876-40f1-9dae-4afb19754f62 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:13.522403 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1a9e5b1d-e876-40f1-9dae-4afb19754f62 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:13.522831 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1a9e5b1d-e876-40f1-9dae-4afb19754f62 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:13.686155 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1a9e5b1d-e876-40f1-9dae-4afb19754f62 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:13.694337 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1a9e5b1d-e876-40f1-9dae-4afb19754f62 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.184559 Dec 13 16:50:13.695067 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 127/248] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:13 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:13.770892 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-980b28cb-ad27-4d3e-b8c9-89fbeb9cc7fc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 202 len: 0 microversion: 2.20 time: 0.351898 Dec 13 16:50:13.771537 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 122/249] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:13 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:50:13.780240 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:13.780957 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:13.788224 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:13.788887 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:13.789680 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:13.790137 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:13.938044 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:13.946010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:13.947483 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:13.948675 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3af1a0e5-0611-4328-b131-9a37ba307c8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.172335 Dec 13 16:50:13.949215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 128/250] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:13 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:50:14.713300 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e53ef2cc-8257-4c4b-a002-13d04d886843 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:14.713935 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e53ef2cc-8257-4c4b-a002-13d04d886843 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:14.720956 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e53ef2cc-8257-4c4b-a002-13d04d886843 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:14.721407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e53ef2cc-8257-4c4b-a002-13d04d886843 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:14.722191 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e53ef2cc-8257-4c4b-a002-13d04d886843 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:14.722624 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e53ef2cc-8257-4c4b-a002-13d04d886843 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:14.837565 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2befbb06-e0b1-4d61-baed-5c705fb663ca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2c0ce40-96f2-40b4-a3ad-c088b2fd46fe"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:14.838677 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2befbb06-e0b1-4d61-baed-5c705fb663ca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:14.847574 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2befbb06-e0b1-4d61-baed-5c705fb663ca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:14.848009 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2befbb06-e0b1-4d61-baed-5c705fb663ca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:14.848815 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2befbb06-e0b1-4d61-baed-5c705fb663ca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:14.849262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2befbb06-e0b1-4d61-baed-5c705fb663ca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:14.862281 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e53ef2cc-8257-4c4b-a002-13d04d886843 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:14.870186 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e53ef2cc-8257-4c4b-a002-13d04d886843 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.161286 Dec 13 16:50:14.870845 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 123/251] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:14 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:14.967195 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:14.967621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:14.975322 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:14.975767 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:14.976555 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:14.977005 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:15.120304 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:15.121655 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2befbb06-e0b1-4d61-baed-5c705fb663ca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288029 Dec 13 16:50:15.122462 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 129/252] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:50:14 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:50:15.129368 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:15.130871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:15.133407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-92262125-57bf-4a5d-b38a-821dd167523d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.168905 Dec 13 16:50:15.139271 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 124/253] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:14 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:15.887710 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fdd88689-837d-406d-b693-fc33abfab996 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:15.888491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fdd88689-837d-406d-b693-fc33abfab996 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:15.896529 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fdd88689-837d-406d-b693-fc33abfab996 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:15.896999 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fdd88689-837d-406d-b693-fc33abfab996 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:15.897794 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fdd88689-837d-406d-b693-fc33abfab996 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:15.898352 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fdd88689-837d-406d-b693-fc33abfab996 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:16.103398 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fdd88689-837d-406d-b693-fc33abfab996 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:16.111942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fdd88689-837d-406d-b693-fc33abfab996 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.228376 Dec 13 16:50:16.112443 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 130/254] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:15 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:16.150589 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:16.151192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:16.158272 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:16.158636 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:16.159411 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:16.159840 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:16.306185 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:16.314406 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:16.316394 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:16.317856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1a5ff0a1-b1ab-4b3a-a208-56b257cbb3a6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.170808 Dec 13 16:50:16.318794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 125/255] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:16 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:17.131491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f0737984-8834-4621-af2b-16ce68be3e64 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:17.132129 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f0737984-8834-4621-af2b-16ce68be3e64 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:17.139123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f0737984-8834-4621-af2b-16ce68be3e64 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:17.139568 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f0737984-8834-4621-af2b-16ce68be3e64 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:17.140346 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f0737984-8834-4621-af2b-16ce68be3e64 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:17.140832 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f0737984-8834-4621-af2b-16ce68be3e64 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:17.283049 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f0737984-8834-4621-af2b-16ce68be3e64 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:17.290622 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f0737984-8834-4621-af2b-16ce68be3e64 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.162877 Dec 13 16:50:17.291226 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 131/256] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:17 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:17.336703 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:17.337444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:17.343885 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:17.344315 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:17.345138 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:17.345748 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:17.485541 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:17.493522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:17.495350 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:17.496498 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-39c70206-2901-4103-8804-0b5fe3633c66 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.163668 Dec 13 16:50:17.497109 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 126/257] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:17 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:18.309566 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e0c6bd34-210e-4fc5-9ff3-79a37d2090c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:18.310563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e0c6bd34-210e-4fc5-9ff3-79a37d2090c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:18.320769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e0c6bd34-210e-4fc5-9ff3-79a37d2090c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:18.321426 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e0c6bd34-210e-4fc5-9ff3-79a37d2090c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:18.322714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e0c6bd34-210e-4fc5-9ff3-79a37d2090c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:18.323328 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e0c6bd34-210e-4fc5-9ff3-79a37d2090c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:18.477757 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e0c6bd34-210e-4fc5-9ff3-79a37d2090c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:18.486101 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e0c6bd34-210e-4fc5-9ff3-79a37d2090c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.182480 Dec 13 16:50:18.486837 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 132/258] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:18 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:18.515336 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:18.515950 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:18.522502 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:18.522947 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:18.523721 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:18.524148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:18.664407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:18.672529 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:18.674078 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:18.675237 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-fe7ae230-2c21-45d3-82df-09b9f329c925 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.163698 Dec 13 16:50:18.675799 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 127/259] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:18 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:19.506886 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d214d62f-d5ed-431e-8e9d-334d91120fff tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:19.507509 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d214d62f-d5ed-431e-8e9d-334d91120fff tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:19.515096 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d214d62f-d5ed-431e-8e9d-334d91120fff tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:19.515547 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d214d62f-d5ed-431e-8e9d-334d91120fff tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:19.516355 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d214d62f-d5ed-431e-8e9d-334d91120fff tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:19.517048 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d214d62f-d5ed-431e-8e9d-334d91120fff tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:19.668115 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d214d62f-d5ed-431e-8e9d-334d91120fff tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:19.684399 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d214d62f-d5ed-431e-8e9d-334d91120fff tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.180835 Dec 13 16:50:19.685808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 133/260] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:19 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:19.696800 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:19.697636 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:19.706711 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:19.707573 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:19.708857 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:19.710276 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:19.871798 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:19.880541 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:19.882210 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:19.883477 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6cdba0bb-f4e2-400c-b9c0-9cf57eee4b38 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.191724 Dec 13 16:50:19.884122 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 128/261] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:19 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:50:20.702499 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-aae36e63-47fc-45fc-9aa3-179a8358eb19 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:20.703363 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-aae36e63-47fc-45fc-9aa3-179a8358eb19 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:20.711850 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aae36e63-47fc-45fc-9aa3-179a8358eb19 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:20.712310 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aae36e63-47fc-45fc-9aa3-179a8358eb19 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:20.713142 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aae36e63-47fc-45fc-9aa3-179a8358eb19 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:20.713559 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aae36e63-47fc-45fc-9aa3-179a8358eb19 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:20.884853 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-aae36e63-47fc-45fc-9aa3-179a8358eb19 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:20.892861 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-aae36e63-47fc-45fc-9aa3-179a8358eb19 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.193902 Dec 13 16:50:20.893470 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 134/262] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:20 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:20.902892 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:20.903516 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:20.911039 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:20.911508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:20.912322 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:20.912797 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:21.061291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:21.070291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:21.071796 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:21.073009 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c2bb6c13-f076-4e70-aeb4-4735d414169b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.174149 Dec 13 16:50:21.073816 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 129/263] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:20 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:21.912526 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b49f1297-665d-4dac-a12c-19c6308d01d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:21.913141 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b49f1297-665d-4dac-a12c-19c6308d01d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:21.920195 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b49f1297-665d-4dac-a12c-19c6308d01d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:21.920829 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b49f1297-665d-4dac-a12c-19c6308d01d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:21.921839 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b49f1297-665d-4dac-a12c-19c6308d01d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:21.922072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b49f1297-665d-4dac-a12c-19c6308d01d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:21.988276 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-354899410", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:22.052084 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] validate_networks() for None {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:50:22.224610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b49f1297-665d-4dac-a12c-19c6308d01d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:22.234230 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b49f1297-665d-4dac-a12c-19c6308d01d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.325988 Dec 13 16:50:22.234853 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 135/264] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:21 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:22.241131 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:22.242459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:22.250835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:22.253084 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:22.254640 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:22.255562 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:22.366941 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:50:22.367372 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:50:22.367846 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:50:22.368248 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:50:22.368756 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:50:22.379173 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:22.379629 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:22.380462 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:22.380934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:22.400400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Getting quotas for project 573f4507ec8f41eb938c17dc3c07cb4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:50:22.405909 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Getting quotas for user 6c3a05e2599149449be08cc2ed91082c and project 573f4507ec8f41eb938c17dc3c07cb4e. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:50:22.420441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:50:22.423217 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:50:22.430311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:22.443633 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:22.445870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:22.447498 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-877b382d-04a3-44cd-92a7-b6f266d8a8ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.210504 Dec 13 16:50:22.448265 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 136/265] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:22 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:22.471769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e956e937-614d-434f-af0c-1ba798371cc2 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488616 Dec 13 16:50:22.472499 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 130/266] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:50:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:50:22.482746 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ef05052a-ec55-4771-a98c-48ce99ee7cc5 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:22.483388 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ef05052a-ec55-4771-a98c-48ce99ee7cc5 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:22.588989 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ef05052a-ec55-4771-a98c-48ce99ee7cc5 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:22.600980 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ef05052a-ec55-4771-a98c-48ce99ee7cc5 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1214 microversion: 2.1 time: 0.121782 Dec 13 16:50:22.601771 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 137/267] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:22 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:22.706621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e767f56d-f1f2-4997-aa27-0fa4fd91374b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:22.715285 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e767f56d-f1f2-4997-aa27-0fa4fd91374b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:22.716015 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e767f56d-f1f2-4997-aa27-0fa4fd91374b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:22.790779 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e767f56d-f1f2-4997-aa27-0fa4fd91374b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Going to try to stop instance {{(pid=122886) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 13 16:50:22.991252 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e767f56d-f1f2-4997-aa27-0fa4fd91374b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 202 len: 0 microversion: 2.1 time: 0.289448 Dec 13 16:50:22.991968 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 131/268] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:22 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:50:23.003084 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-be19098c-cec4-430a-8e2f-d098b39a38e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:23.003880 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-be19098c-cec4-430a-8e2f-d098b39a38e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:23.012500 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-be19098c-cec4-430a-8e2f-d098b39a38e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:23.013206 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-be19098c-cec4-430a-8e2f-d098b39a38e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:23.014877 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-be19098c-cec4-430a-8e2f-d098b39a38e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:23.015325 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-be19098c-cec4-430a-8e2f-d098b39a38e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:23.161196 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-be19098c-cec4-430a-8e2f-d098b39a38e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:23.170514 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-be19098c-cec4-430a-8e2f-d098b39a38e6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.173576 Dec 13 16:50:23.171094 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 138/269] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:22 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:23.257483 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-296e1579-e306-4f22-9769-d708e5f91106 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:23.258110 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-296e1579-e306-4f22-9769-d708e5f91106 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:23.265010 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-296e1579-e306-4f22-9769-d708e5f91106 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:23.265461 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-296e1579-e306-4f22-9769-d708e5f91106 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:23.266225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-296e1579-e306-4f22-9769-d708e5f91106 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:23.266654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-296e1579-e306-4f22-9769-d708e5f91106 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:23.402967 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-296e1579-e306-4f22-9769-d708e5f91106 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:23.410757 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-296e1579-e306-4f22-9769-d708e5f91106 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.161575 Dec 13 16:50:23.411342 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 132/270] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:23 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:23.467296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:23.467917 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:23.474717 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:23.475181 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:23.476089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:23.476387 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:23.622796 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a77163fb-c1b5-43f4-813a-0f4e56148284 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:23.623649 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a77163fb-c1b5-43f4-813a-0f4e56148284 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:23.640401 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a77163fb-c1b5-43f4-813a-0f4e56148284 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:23.641297 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a77163fb-c1b5-43f4-813a-0f4e56148284 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:23.642262 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a77163fb-c1b5-43f4-813a-0f4e56148284 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:23.642958 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a77163fb-c1b5-43f4-813a-0f4e56148284 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:23.712976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a77163fb-c1b5-43f4-813a-0f4e56148284 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:23.722246 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a77163fb-c1b5-43f4-813a-0f4e56148284 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1284 microversion: 2.1 time: 0.103323 Dec 13 16:50:23.724658 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 133/271] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:23 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:23.816054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:23.832003 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:23.834286 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:23.836211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c62be5ff-68e7-400a-9a8b-3211039105f3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.372787 Dec 13 16:50:23.840234 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 139/272] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:23 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:24.187210 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-01a68e8f-e668-4d83-bd4a-ba7a82500c51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:24.188507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-01a68e8f-e668-4d83-bd4a-ba7a82500c51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:24.195166 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-01a68e8f-e668-4d83-bd4a-ba7a82500c51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:24.195605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-01a68e8f-e668-4d83-bd4a-ba7a82500c51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:24.196389 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-01a68e8f-e668-4d83-bd4a-ba7a82500c51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:24.196844 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-01a68e8f-e668-4d83-bd4a-ba7a82500c51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:24.341018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-01a68e8f-e668-4d83-bd4a-ba7a82500c51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:24.351301 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-01a68e8f-e668-4d83-bd4a-ba7a82500c51 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.167588 Dec 13 16:50:24.351919 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 134/273] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:24 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:24.427664 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-77c9efd6-d505-4e4d-b57e-b41caeb23d5d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:24.428762 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-77c9efd6-d505-4e4d-b57e-b41caeb23d5d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:24.435568 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-77c9efd6-d505-4e4d-b57e-b41caeb23d5d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:24.435998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-77c9efd6-d505-4e4d-b57e-b41caeb23d5d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:24.436810 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-77c9efd6-d505-4e4d-b57e-b41caeb23d5d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:24.437243 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-77c9efd6-d505-4e4d-b57e-b41caeb23d5d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:24.688156 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-77c9efd6-d505-4e4d-b57e-b41caeb23d5d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:24.701550 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-77c9efd6-d505-4e4d-b57e-b41caeb23d5d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.277241 Dec 13 16:50:24.702571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 140/274] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:24 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:24.739425 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6c13d773-9542-40a4-8567-e24cd087ed86 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:24.740121 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6c13d773-9542-40a4-8567-e24cd087ed86 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:24.747071 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c13d773-9542-40a4-8567-e24cd087ed86 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:24.747663 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c13d773-9542-40a4-8567-e24cd087ed86 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:24.748522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c13d773-9542-40a4-8567-e24cd087ed86 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:24.749072 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c13d773-9542-40a4-8567-e24cd087ed86 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:24.855128 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:24.856031 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:24.863174 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:24.863884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:24.864870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:24.865293 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:24.900198 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6c13d773-9542-40a4-8567-e24cd087ed86 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:24.908807 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6c13d773-9542-40a4-8567-e24cd087ed86 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.173019 Dec 13 16:50:24.909388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 135/275] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:24 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:25.294029 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:25.302455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:25.303916 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:25.305355 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cf0f84f1-a796-4232-9b29-9adf4e168fd9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.453918 Dec 13 16:50:25.305945 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 141/276] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:24 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:50:25.372476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8f855bb7-6729-4aec-966b-054a6c24a2ec tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:25.373488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8f855bb7-6729-4aec-966b-054a6c24a2ec tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:25.388346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8f855bb7-6729-4aec-966b-054a6c24a2ec tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:25.388829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8f855bb7-6729-4aec-966b-054a6c24a2ec tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:25.389658 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8f855bb7-6729-4aec-966b-054a6c24a2ec tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:25.390094 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8f855bb7-6729-4aec-966b-054a6c24a2ec tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:25.542151 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8f855bb7-6729-4aec-966b-054a6c24a2ec tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:25.551131 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8f855bb7-6729-4aec-966b-054a6c24a2ec tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.183408 Dec 13 16:50:25.552267 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 136/277] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:25 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:25.618881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-ca7757e1-c597-46dc-94df-d22fed72728a req-a49c25e9-7017-4dcc-bbce-c15e2fa5389e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5507551-35a1-4dc3-81d7-4eda23f04070", "tag": "22f4ecd9-4abb-481c-a85b-bfff4bfb33cf"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:25.621075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:50:25.621075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:50:25.630049 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-ca7757e1-c597-46dc-94df-d22fed72728a req-a49c25e9-7017-4dcc-bbce-c15e2fa5389e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:25.630503 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-ca7757e1-c597-46dc-94df-d22fed72728a req-a49c25e9-7017-4dcc-bbce-c15e2fa5389e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:25.650518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-ca7757e1-c597-46dc-94df-d22fed72728a req-a49c25e9-7017-4dcc-bbce-c15e2fa5389e service nova] Creating event network-changed:22f4ecd9-4abb-481c-a85b-bfff4bfb33cf for instance a5507551-35a1-4dc3-81d7-4eda23f04070 on hv-cinder-82160 Dec 13 16:50:25.656440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-ca7757e1-c597-46dc-94df-d22fed72728a req-a49c25e9-7017-4dcc-bbce-c15e2fa5389e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042688 Dec 13 16:50:25.656988 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 142/278] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:50:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:50:25.722123 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-15f1306b-0b1b-4d53-ac19-5b2de0c204f0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:25.722988 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-15f1306b-0b1b-4d53-ac19-5b2de0c204f0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:25.730216 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15f1306b-0b1b-4d53-ac19-5b2de0c204f0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:25.730664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15f1306b-0b1b-4d53-ac19-5b2de0c204f0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:25.731613 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15f1306b-0b1b-4d53-ac19-5b2de0c204f0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:25.732101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15f1306b-0b1b-4d53-ac19-5b2de0c204f0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:25.880077 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-15f1306b-0b1b-4d53-ac19-5b2de0c204f0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:25.888400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-15f1306b-0b1b-4d53-ac19-5b2de0c204f0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.170707 Dec 13 16:50:25.889012 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 137/279] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:25 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:25.927617 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2e6e6f7c-7c96-41cb-9049-068fe221bac9 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:25.928311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2e6e6f7c-7c96-41cb-9049-068fe221bac9 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:25.934728 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e6e6f7c-7c96-41cb-9049-068fe221bac9 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:25.935206 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e6e6f7c-7c96-41cb-9049-068fe221bac9 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:25.935987 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e6e6f7c-7c96-41cb-9049-068fe221bac9 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:25.936413 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e6e6f7c-7c96-41cb-9049-068fe221bac9 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:26.079812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2e6e6f7c-7c96-41cb-9049-068fe221bac9 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:26.087973 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2e6e6f7c-7c96-41cb-9049-068fe221bac9 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.165195 Dec 13 16:50:26.088545 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 143/280] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:25 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:26.324934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:26.324934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:26.335065 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:26.335527 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:26.336390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:26.336856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:26.479229 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:26.488097 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:26.489887 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:26.491057 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-526a1cc6-774b-4c4c-80ac-65ddfec8303c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.170854 Dec 13 16:50:26.491603 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 138/281] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:26 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:26.569413 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-43f65a6a-81a3-4178-9dd7-67551a2fefa9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:26.570012 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-43f65a6a-81a3-4178-9dd7-67551a2fefa9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:26.576510 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43f65a6a-81a3-4178-9dd7-67551a2fefa9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:26.576918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43f65a6a-81a3-4178-9dd7-67551a2fefa9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:26.577688 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43f65a6a-81a3-4178-9dd7-67551a2fefa9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:26.578119 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43f65a6a-81a3-4178-9dd7-67551a2fefa9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:26.720135 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-43f65a6a-81a3-4178-9dd7-67551a2fefa9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:26.734173 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-43f65a6a-81a3-4178-9dd7-67551a2fefa9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.168475 Dec 13 16:50:26.734754 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 144/282] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:26 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:26.908731 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a129303f-988b-4102-99d0-16f8e63a27bc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:26.909268 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a129303f-988b-4102-99d0-16f8e63a27bc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:26.916883 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a129303f-988b-4102-99d0-16f8e63a27bc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:26.917322 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a129303f-988b-4102-99d0-16f8e63a27bc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:26.918103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a129303f-988b-4102-99d0-16f8e63a27bc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:26.918525 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a129303f-988b-4102-99d0-16f8e63a27bc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:27.056246 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a129303f-988b-4102-99d0-16f8e63a27bc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:27.063895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a129303f-988b-4102-99d0-16f8e63a27bc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.160944 Dec 13 16:50:27.064464 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 139/283] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:26 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:27.105183 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9a148cc5-dd8f-4dff-9870-e849453afd1d tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:27.105790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9a148cc5-dd8f-4dff-9870-e849453afd1d tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:27.112741 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9a148cc5-dd8f-4dff-9870-e849453afd1d tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:27.113189 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9a148cc5-dd8f-4dff-9870-e849453afd1d tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:27.113966 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9a148cc5-dd8f-4dff-9870-e849453afd1d tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:27.114372 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9a148cc5-dd8f-4dff-9870-e849453afd1d tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:27.257602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9a148cc5-dd8f-4dff-9870-e849453afd1d tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:27.266200 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9a148cc5-dd8f-4dff-9870-e849453afd1d tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.164619 Dec 13 16:50:27.266792 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 145/284] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:27 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:27.510045 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:27.510640 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:27.517053 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:27.517496 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:27.518962 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:27.519401 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:27.662358 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:27.670765 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:27.672251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:27.673435 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0509e5f4-12b7-452a-93a9-6155549eab07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.167393 Dec 13 16:50:27.673993 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 140/285] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:27 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:27.751772 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-40966020-a3eb-4d59-8d3c-6d4ecb0c5857 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:27.752529 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-40966020-a3eb-4d59-8d3c-6d4ecb0c5857 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:27.759223 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-40966020-a3eb-4d59-8d3c-6d4ecb0c5857 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:27.759662 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-40966020-a3eb-4d59-8d3c-6d4ecb0c5857 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:27.760495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-40966020-a3eb-4d59-8d3c-6d4ecb0c5857 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:27.760895 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-40966020-a3eb-4d59-8d3c-6d4ecb0c5857 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:27.901877 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-40966020-a3eb-4d59-8d3c-6d4ecb0c5857 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:27.910439 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-40966020-a3eb-4d59-8d3c-6d4ecb0c5857 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.162631 Dec 13 16:50:27.910983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 146/286] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:27 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:28.083588 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bec013e9-7c8c-4c29-9fb4-b8bd6b0c9c67 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:28.084094 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bec013e9-7c8c-4c29-9fb4-b8bd6b0c9c67 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:28.090711 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bec013e9-7c8c-4c29-9fb4-b8bd6b0c9c67 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:28.091219 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bec013e9-7c8c-4c29-9fb4-b8bd6b0c9c67 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:28.091992 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bec013e9-7c8c-4c29-9fb4-b8bd6b0c9c67 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:28.092418 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bec013e9-7c8c-4c29-9fb4-b8bd6b0c9c67 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:28.231963 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bec013e9-7c8c-4c29-9fb4-b8bd6b0c9c67 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:28.239795 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bec013e9-7c8c-4c29-9fb4-b8bd6b0c9c67 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.160957 Dec 13 16:50:28.240379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 141/287] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:28 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:28.288160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-536b9d92-8f58-4938-bd43-f9082575cffd tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:28.288804 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-536b9d92-8f58-4938-bd43-f9082575cffd tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:28.298418 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-536b9d92-8f58-4938-bd43-f9082575cffd tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:28.298983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-536b9d92-8f58-4938-bd43-f9082575cffd tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:28.299852 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-536b9d92-8f58-4938-bd43-f9082575cffd tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:28.300279 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-536b9d92-8f58-4938-bd43-f9082575cffd tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:28.494443 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-536b9d92-8f58-4938-bd43-f9082575cffd tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:28.504085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-536b9d92-8f58-4938-bd43-f9082575cffd tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.221622 Dec 13 16:50:28.504931 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 147/288] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:28 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:28.693915 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:28.694539 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:28.701313 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:28.701764 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:28.702554 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:28.702988 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:28.859782 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:28.872258 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:28.873815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:28.875018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8a87456b-302c-44a9-bc42-9dc206442a29 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.186996 Dec 13 16:50:28.875671 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 142/289] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:28 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:28.930085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1d218cf4-0cdc-4889-9928-673528743670 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:28.930743 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1d218cf4-0cdc-4889-9928-673528743670 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:28.937333 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d218cf4-0cdc-4889-9928-673528743670 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:28.937787 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d218cf4-0cdc-4889-9928-673528743670 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:28.938674 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d218cf4-0cdc-4889-9928-673528743670 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:28.939096 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d218cf4-0cdc-4889-9928-673528743670 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:29.085299 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1d218cf4-0cdc-4889-9928-673528743670 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:29.093530 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1d218cf4-0cdc-4889-9928-673528743670 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.169401 Dec 13 16:50:29.094097 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 148/290] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:28 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:29.257772 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-06816d94-bffb-4117-8bd7-efa0d10c3576 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:29.258377 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-06816d94-bffb-4117-8bd7-efa0d10c3576 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:29.264846 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-06816d94-bffb-4117-8bd7-efa0d10c3576 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:29.265320 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-06816d94-bffb-4117-8bd7-efa0d10c3576 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:29.266103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-06816d94-bffb-4117-8bd7-efa0d10c3576 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:29.266519 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-06816d94-bffb-4117-8bd7-efa0d10c3576 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:29.412607 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-06816d94-bffb-4117-8bd7-efa0d10c3576 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:29.421326 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-06816d94-bffb-4117-8bd7-efa0d10c3576 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.167265 Dec 13 16:50:29.421910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 143/291] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:29 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:29.522403 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b6e26ea7-2de7-4330-8e67-ac208a835669 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:29.523000 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b6e26ea7-2de7-4330-8e67-ac208a835669 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:29.529175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b6e26ea7-2de7-4330-8e67-ac208a835669 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:29.529628 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b6e26ea7-2de7-4330-8e67-ac208a835669 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:29.530425 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b6e26ea7-2de7-4330-8e67-ac208a835669 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:29.530833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b6e26ea7-2de7-4330-8e67-ac208a835669 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:29.670525 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b6e26ea7-2de7-4330-8e67-ac208a835669 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:29.679332 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b6e26ea7-2de7-4330-8e67-ac208a835669 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.161230 Dec 13 16:50:29.679929 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 149/292] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:29 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:29.894491 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:29.895061 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:29.902307 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:29.902812 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:29.903525 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:29.903980 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:30.043460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:30.052267 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:30.053801 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:30.054958 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-53ceaabb-12bd-41e4-a163-ba230631950b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.165201 Dec 13 16:50:30.055523 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 144/293] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:29 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:30.111388 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-63e2f9be-fb4c-4e09-9cc4-b307c326ec23 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:30.112045 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-63e2f9be-fb4c-4e09-9cc4-b307c326ec23 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:30.118838 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63e2f9be-fb4c-4e09-9cc4-b307c326ec23 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:30.119776 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63e2f9be-fb4c-4e09-9cc4-b307c326ec23 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:30.120551 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63e2f9be-fb4c-4e09-9cc4-b307c326ec23 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:30.121007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63e2f9be-fb4c-4e09-9cc4-b307c326ec23 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:30.264628 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-63e2f9be-fb4c-4e09-9cc4-b307c326ec23 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:30.273237 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-63e2f9be-fb4c-4e09-9cc4-b307c326ec23 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.165562 Dec 13 16:50:30.273837 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 150/294] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:30 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:30.438931 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b56c28d0-e77f-4ded-ba88-91d363e0e7e7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:30.439513 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b56c28d0-e77f-4ded-ba88-91d363e0e7e7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:30.446317 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b56c28d0-e77f-4ded-ba88-91d363e0e7e7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:30.446720 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b56c28d0-e77f-4ded-ba88-91d363e0e7e7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:30.447520 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b56c28d0-e77f-4ded-ba88-91d363e0e7e7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:30.447953 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b56c28d0-e77f-4ded-ba88-91d363e0e7e7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:30.591999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b56c28d0-e77f-4ded-ba88-91d363e0e7e7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:30.603625 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b56c28d0-e77f-4ded-ba88-91d363e0e7e7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.168106 Dec 13 16:50:30.604981 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 145/295] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:30 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:30.703742 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-df0e40b2-397b-4a5d-bcbc-9735a22b587f tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:30.704433 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-df0e40b2-397b-4a5d-bcbc-9735a22b587f tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:30.714244 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-df0e40b2-397b-4a5d-bcbc-9735a22b587f tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:30.714834 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-df0e40b2-397b-4a5d-bcbc-9735a22b587f tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:30.715791 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-df0e40b2-397b-4a5d-bcbc-9735a22b587f tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:30.716293 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-df0e40b2-397b-4a5d-bcbc-9735a22b587f tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:30.899922 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-df0e40b2-397b-4a5d-bcbc-9735a22b587f tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:30.909838 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-df0e40b2-397b-4a5d-bcbc-9735a22b587f tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.212279 Dec 13 16:50:30.910563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 151/296] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:30 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:31.075222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:31.075834 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:31.085212 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:31.085561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:31.086320 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:31.086771 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:31.265438 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:31.277763 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:31.279256 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:31.280422 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4a45e1b8-3be8-492b-9685-eb8c07b09280 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.209723 Dec 13 16:50:31.281442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 146/297] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:31 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:31.295103 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-792177b8-4c55-4cd0-afde-5d0a3622f7e3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:31.295775 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-792177b8-4c55-4cd0-afde-5d0a3622f7e3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:31.303881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-792177b8-4c55-4cd0-afde-5d0a3622f7e3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:31.304325 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-792177b8-4c55-4cd0-afde-5d0a3622f7e3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:31.305152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-792177b8-4c55-4cd0-afde-5d0a3622f7e3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:31.305586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-792177b8-4c55-4cd0-afde-5d0a3622f7e3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:31.461542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-792177b8-4c55-4cd0-afde-5d0a3622f7e3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:31.471297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-792177b8-4c55-4cd0-afde-5d0a3622f7e3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.182561 Dec 13 16:50:31.472206 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 152/298] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:31 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:31.623383 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8324e81c-ec22-449f-b5f5-dd26be2e49dc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:31.624103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8324e81c-ec22-449f-b5f5-dd26be2e49dc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:31.630884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8324e81c-ec22-449f-b5f5-dd26be2e49dc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:31.631532 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8324e81c-ec22-449f-b5f5-dd26be2e49dc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:31.632393 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8324e81c-ec22-449f-b5f5-dd26be2e49dc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:31.632906 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8324e81c-ec22-449f-b5f5-dd26be2e49dc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:31.802474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8324e81c-ec22-449f-b5f5-dd26be2e49dc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:31.811621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8324e81c-ec22-449f-b5f5-dd26be2e49dc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.192742 Dec 13 16:50:31.822456 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 147/299] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:31 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:31.927513 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-32387058-e155-4f61-93bb-82df56aa2be3 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:31.928082 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-32387058-e155-4f61-93bb-82df56aa2be3 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:31.934391 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-32387058-e155-4f61-93bb-82df56aa2be3 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:31.934853 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-32387058-e155-4f61-93bb-82df56aa2be3 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:31.935656 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-32387058-e155-4f61-93bb-82df56aa2be3 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:31.936082 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-32387058-e155-4f61-93bb-82df56aa2be3 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:32.095215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-32387058-e155-4f61-93bb-82df56aa2be3 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:32.103139 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-32387058-e155-4f61-93bb-82df56aa2be3 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.179438 Dec 13 16:50:32.103714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 153/300] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:31 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:32.299580 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:32.300199 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:32.306982 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:32.307456 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:32.308220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:32.308690 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:32.446532 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:32.454616 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:32.456188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:32.457362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bc75e5da-40b1-4b69-a558-48c1bfcde9d4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.161708 Dec 13 16:50:32.457914 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 148/301] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:32 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:32.491097 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9e00d9aa-275c-4705-b163-246c7b44a601 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:32.491697 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9e00d9aa-275c-4705-b163-246c7b44a601 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:32.498788 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9e00d9aa-275c-4705-b163-246c7b44a601 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:32.499236 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9e00d9aa-275c-4705-b163-246c7b44a601 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:32.500016 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9e00d9aa-275c-4705-b163-246c7b44a601 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:32.500448 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9e00d9aa-275c-4705-b163-246c7b44a601 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:32.638647 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9e00d9aa-275c-4705-b163-246c7b44a601 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:32.647014 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9e00d9aa-275c-4705-b163-246c7b44a601 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.159677 Dec 13 16:50:32.647580 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 154/302] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:32 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:32.829927 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a71d74b6-f56f-4281-aaeb-8493db1b261d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:32.830780 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a71d74b6-f56f-4281-aaeb-8493db1b261d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:32.837655 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a71d74b6-f56f-4281-aaeb-8493db1b261d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:32.838029 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a71d74b6-f56f-4281-aaeb-8493db1b261d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:32.838816 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a71d74b6-f56f-4281-aaeb-8493db1b261d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:32.839357 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a71d74b6-f56f-4281-aaeb-8493db1b261d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:32.988866 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a71d74b6-f56f-4281-aaeb-8493db1b261d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:32.997003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a71d74b6-f56f-4281-aaeb-8493db1b261d tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.170915 Dec 13 16:50:32.997572 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 149/303] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:32 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:33.120199 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a52482c0-edb8-40c3-99e5-148bd3fe0337 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:33.121280 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a52482c0-edb8-40c3-99e5-148bd3fe0337 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:33.128263 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a52482c0-edb8-40c3-99e5-148bd3fe0337 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:33.128625 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a52482c0-edb8-40c3-99e5-148bd3fe0337 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:33.129571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a52482c0-edb8-40c3-99e5-148bd3fe0337 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:33.130010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a52482c0-edb8-40c3-99e5-148bd3fe0337 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:33.277074 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a52482c0-edb8-40c3-99e5-148bd3fe0337 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:33.285951 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a52482c0-edb8-40c3-99e5-148bd3fe0337 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.170276 Dec 13 16:50:33.286522 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 155/304] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:33 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:33.475743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:33.476374 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:33.483347 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:33.483794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:33.484756 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:33.485039 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:33.635918 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:33.645285 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:33.646895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:33.648171 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a687dbfc-fc46-499d-8adf-8921036dc994 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.176295 Dec 13 16:50:33.648852 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 150/305] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:33 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:33.665197 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-97b65cfb-32a1-48f7-bdf4-29d79cfefe0e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:33.665812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-97b65cfb-32a1-48f7-bdf4-29d79cfefe0e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:33.672443 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-97b65cfb-32a1-48f7-bdf4-29d79cfefe0e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:33.673239 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-97b65cfb-32a1-48f7-bdf4-29d79cfefe0e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:33.674223 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-97b65cfb-32a1-48f7-bdf4-29d79cfefe0e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:33.675138 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-97b65cfb-32a1-48f7-bdf4-29d79cfefe0e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:33.704106 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-4b48eef4-5e56-49b9-a5cd-fe3fe66f7613 req-dcff952b-f0c4-40e9-a026-501c2e38fc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5507551-35a1-4dc3-81d7-4eda23f04070", "name": "network-vif-plugged", "status": "completed", "tag": "22f4ecd9-4abb-481c-a85b-bfff4bfb33cf"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:33.706436 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:50:33.706436 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:50:33.714509 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-4b48eef4-5e56-49b9-a5cd-fe3fe66f7613 req-dcff952b-f0c4-40e9-a026-501c2e38fc7e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:33.714953 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-4b48eef4-5e56-49b9-a5cd-fe3fe66f7613 req-dcff952b-f0c4-40e9-a026-501c2e38fc7e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:33.733302 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-4b48eef4-5e56-49b9-a5cd-fe3fe66f7613 req-dcff952b-f0c4-40e9-a026-501c2e38fc7e service nova] Creating event network-vif-plugged:22f4ecd9-4abb-481c-a85b-bfff4bfb33cf for instance a5507551-35a1-4dc3-81d7-4eda23f04070 on hv-cinder-82160 Dec 13 16:50:33.741293 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-4b48eef4-5e56-49b9-a5cd-fe3fe66f7613 req-dcff952b-f0c4-40e9-a026-501c2e38fc7e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041835 Dec 13 16:50:33.742121 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 151/306] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:50:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:50:33.822261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-97b65cfb-32a1-48f7-bdf4-29d79cfefe0e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:33.836084 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-97b65cfb-32a1-48f7-bdf4-29d79cfefe0e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.174602 Dec 13 16:50:33.837088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 156/307] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:33 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:34.015083 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-026c1ab3-0f1f-46a1-99cb-e47aa9bff864 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:34.015903 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-026c1ab3-0f1f-46a1-99cb-e47aa9bff864 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:34.023007 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-026c1ab3-0f1f-46a1-99cb-e47aa9bff864 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:34.023466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-026c1ab3-0f1f-46a1-99cb-e47aa9bff864 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:34.024251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-026c1ab3-0f1f-46a1-99cb-e47aa9bff864 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:34.024712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-026c1ab3-0f1f-46a1-99cb-e47aa9bff864 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:34.173780 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-026c1ab3-0f1f-46a1-99cb-e47aa9bff864 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:34.182053 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-026c1ab3-0f1f-46a1-99cb-e47aa9bff864 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.170894 Dec 13 16:50:34.182633 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 152/308] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:34 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:34.303123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2639c44d-6055-490e-a5ec-153ec3d22ea6 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:34.303713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2639c44d-6055-490e-a5ec-153ec3d22ea6 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:34.314322 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2639c44d-6055-490e-a5ec-153ec3d22ea6 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:34.315001 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2639c44d-6055-490e-a5ec-153ec3d22ea6 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:34.316343 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2639c44d-6055-490e-a5ec-153ec3d22ea6 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:34.316851 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2639c44d-6055-490e-a5ec-153ec3d22ea6 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:34.490054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2639c44d-6055-490e-a5ec-153ec3d22ea6 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:34.498553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2639c44d-6055-490e-a5ec-153ec3d22ea6 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1314 microversion: 2.1 time: 0.199702 Dec 13 16:50:34.501031 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 157/309] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:34 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:34.666339 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:34.666961 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:34.675197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:34.675991 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:34.677066 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:34.677652 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:34.863190 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-687b11e0-b5f7-4c1a-882f-8d84ba5fe438 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:34.863788 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-687b11e0-b5f7-4c1a-882f-8d84ba5fe438 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:34.871035 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-687b11e0-b5f7-4c1a-882f-8d84ba5fe438 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:34.871446 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-687b11e0-b5f7-4c1a-882f-8d84ba5fe438 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:34.872464 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-687b11e0-b5f7-4c1a-882f-8d84ba5fe438 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:34.872890 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-687b11e0-b5f7-4c1a-882f-8d84ba5fe438 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:34.878848 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:34.891358 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:34.892924 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:34.894129 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-68f78ab5-44a4-4b99-9086-1d5a029db928 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1745 microversion: 2.20 time: 0.231834 Dec 13 16:50:34.894879 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 153/310] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:34 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1745 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:35.034651 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-687b11e0-b5f7-4c1a-882f-8d84ba5fe438 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:35.043350 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-687b11e0-b5f7-4c1a-882f-8d84ba5fe438 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.183924 Dec 13 16:50:35.044222 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 158/311] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:34 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:50:35.203310 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ef6dc8c5-df25-4ed4-ad3d-30ddb400ac61 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:35.204316 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ef6dc8c5-df25-4ed4-ad3d-30ddb400ac61 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:35.211787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ef6dc8c5-df25-4ed4-ad3d-30ddb400ac61 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.212498 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ef6dc8c5-df25-4ed4-ad3d-30ddb400ac61 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.215543 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ef6dc8c5-df25-4ed4-ad3d-30ddb400ac61 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.215543 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ef6dc8c5-df25-4ed4-ad3d-30ddb400ac61 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.365799 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ef6dc8c5-df25-4ed4-ad3d-30ddb400ac61 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:35.374081 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ef6dc8c5-df25-4ed4-ad3d-30ddb400ac61 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.176552 Dec 13 16:50:35.374747 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 154/312] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:35 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:35.524180 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-888c6711-ccf3-4305-aec1-d7cbe7f434c4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:35.524875 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-888c6711-ccf3-4305-aec1-d7cbe7f434c4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:35.532509 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-888c6711-ccf3-4305-aec1-d7cbe7f434c4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.533302 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-888c6711-ccf3-4305-aec1-d7cbe7f434c4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.534527 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-888c6711-ccf3-4305-aec1-d7cbe7f434c4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.535811 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-888c6711-ccf3-4305-aec1-d7cbe7f434c4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.682823 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-888c6711-ccf3-4305-aec1-d7cbe7f434c4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:35.697187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-888c6711-ccf3-4305-aec1-d7cbe7f434c4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1463 microversion: 2.1 time: 0.182848 Dec 13 16:50:35.698208 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 159/313] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:35 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1463 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:35.750126 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3375e565-aefe-45ea-8ecd-a58161d55c23 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:35.750939 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3375e565-aefe-45ea-8ecd-a58161d55c23 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:35.758701 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3375e565-aefe-45ea-8ecd-a58161d55c23 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.759230 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3375e565-aefe-45ea-8ecd-a58161d55c23 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.760093 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3375e565-aefe-45ea-8ecd-a58161d55c23 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.760792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3375e565-aefe-45ea-8ecd-a58161d55c23 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.791817 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3375e565-aefe-45ea-8ecd-a58161d55c23 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:50:35.915097 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:35.916457 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:35.928096 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.928639 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.929578 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.930044 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.933026 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3375e565-aefe-45ea-8ecd-a58161d55c23 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 204 len: 0 microversion: 2.1 time: 0.188795 Dec 13 16:50:35.933849 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 155/314] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:50:35 2021] DELETE /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:50:35.946348 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4308caa6-fb53-42ef-9bca-4a0d7347ae4b tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:35.947543 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4308caa6-fb53-42ef-9bca-4a0d7347ae4b tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:35.955703 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4308caa6-fb53-42ef-9bca-4a0d7347ae4b tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.956233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4308caa6-fb53-42ef-9bca-4a0d7347ae4b tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:35.957328 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4308caa6-fb53-42ef-9bca-4a0d7347ae4b tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:35.957933 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4308caa6-fb53-42ef-9bca-4a0d7347ae4b tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:36.117657 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:36.126780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:36.128821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:36.130062 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1e9d915e-12eb-4cae-8129-5ec6be7dfc93 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1745 microversion: 2.20 time: 0.219488 Dec 13 16:50:36.140619 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 160/315] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:35 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1745 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:36.149311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9f4a54e3-ab64-4579-9a77-5230271173b1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:36.150029 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9f4a54e3-ab64-4579-9a77-5230271173b1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:36.167383 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9f4a54e3-ab64-4579-9a77-5230271173b1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:36.169275 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9f4a54e3-ab64-4579-9a77-5230271173b1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:36.170470 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9f4a54e3-ab64-4579-9a77-5230271173b1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:36.171612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9f4a54e3-ab64-4579-9a77-5230271173b1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:36.201622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4308caa6-fb53-42ef-9bca-4a0d7347ae4b tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:36.210621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4308caa6-fb53-42ef-9bca-4a0d7347ae4b tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1469 microversion: 2.1 time: 0.271651 Dec 13 16:50:36.213239 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 156/316] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:35 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:50:36.391314 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7bae0881-b2d6-4236-85fc-b7f936614b35 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:36.391959 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7bae0881-b2d6-4236-85fc-b7f936614b35 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:36.401019 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7bae0881-b2d6-4236-85fc-b7f936614b35 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:36.401019 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7bae0881-b2d6-4236-85fc-b7f936614b35 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:36.401019 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7bae0881-b2d6-4236-85fc-b7f936614b35 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:36.401019 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7bae0881-b2d6-4236-85fc-b7f936614b35 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:36.441991 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9f4a54e3-ab64-4579-9a77-5230271173b1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:36.458152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9f4a54e3-ab64-4579-9a77-5230271173b1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.316098 Dec 13 16:50:36.460644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 161/317] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:36 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:36.564153 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7bae0881-b2d6-4236-85fc-b7f936614b35 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:36.577158 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7bae0881-b2d6-4236-85fc-b7f936614b35 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.189304 Dec 13 16:50:36.577764 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 157/318] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:36 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:50:37.150989 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:37.152116 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:37.164419 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.165288 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.167531 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.168306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.235320 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3eeee66d-33b0-460e-afee-6098bc3a23b4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:37.236804 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3eeee66d-33b0-460e-afee-6098bc3a23b4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:37.249068 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3eeee66d-33b0-460e-afee-6098bc3a23b4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.250162 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3eeee66d-33b0-460e-afee-6098bc3a23b4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.251712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3eeee66d-33b0-460e-afee-6098bc3a23b4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.254726 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3eeee66d-33b0-460e-afee-6098bc3a23b4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.446833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:37.457657 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:37.460097 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:37.461611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7349298d-082c-4e7e-a244-dbdb4699ec70 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.317517 Dec 13 16:50:37.462767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 162/319] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:37 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:37.475714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-82c715f0-5e91-4229-a8b6-c1f703224e9f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:37.477410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-82c715f0-5e91-4229-a8b6-c1f703224e9f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:37.491021 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82c715f0-5e91-4229-a8b6-c1f703224e9f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.495011 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82c715f0-5e91-4229-a8b6-c1f703224e9f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.495885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82c715f0-5e91-4229-a8b6-c1f703224e9f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.496333 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82c715f0-5e91-4229-a8b6-c1f703224e9f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.560387 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3eeee66d-33b0-460e-afee-6098bc3a23b4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:37.573787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3eeee66d-33b0-460e-afee-6098bc3a23b4 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1469 microversion: 2.1 time: 0.346607 Dec 13 16:50:37.574915 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 158/320] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:37 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:37.597490 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-cf0bc87a-b531-40c5-8220-2f67dd2efbdd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:37.598506 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-cf0bc87a-b531-40c5-8220-2f67dd2efbdd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:37.607987 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cf0bc87a-b531-40c5-8220-2f67dd2efbdd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.608815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cf0bc87a-b531-40c5-8220-2f67dd2efbdd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.609764 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cf0bc87a-b531-40c5-8220-2f67dd2efbdd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.610359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cf0bc87a-b531-40c5-8220-2f67dd2efbdd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.854160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-82c715f0-5e91-4229-a8b6-c1f703224e9f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:37.864273 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-82c715f0-5e91-4229-a8b6-c1f703224e9f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1724 microversion: 2.1 time: 0.392447 Dec 13 16:50:37.865244 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 163/321] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:37 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:37.870254 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-693a9a50-0ea5-4626-9c86-d1d838f80784 req-761f0631-7efa-44de-a8b1-e7276fbe0830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b9554f-cedc-4ce0-a3d7-c4be33ec154f", "name": "network-vif-plugged", "status": "completed", "tag": "b5225bcb-5258-419f-8497-ad84cf3faa1c"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:37.871821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:50:37.871821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:50:37.880749 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-693a9a50-0ea5-4626-9c86-d1d838f80784 req-761f0631-7efa-44de-a8b1-e7276fbe0830 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:37.881371 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-693a9a50-0ea5-4626-9c86-d1d838f80784 req-761f0631-7efa-44de-a8b1-e7276fbe0830 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:37.895652 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-693a9a50-0ea5-4626-9c86-d1d838f80784 req-761f0631-7efa-44de-a8b1-e7276fbe0830 service nova] Creating event network-vif-plugged:b5225bcb-5258-419f-8497-ad84cf3faa1c for instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f on hv-cinder-82160 Dec 13 16:50:37.900068 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cf0bc87a-b531-40c5-8220-2f67dd2efbdd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:37.901490 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-693a9a50-0ea5-4626-9c86-d1d838f80784 req-761f0631-7efa-44de-a8b1-e7276fbe0830 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035070 Dec 13 16:50:37.902391 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 164/322] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:50:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:50:37.914013 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-cf0bc87a-b531-40c5-8220-2f67dd2efbdd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.321741 Dec 13 16:50:37.915016 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 159/323] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:37 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:50:38.314157 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-856804216", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "be6d796d-91c2-4a3d-9d7c-391778978df8"}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:38.427543 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] validate_networks() for [('be6d796d-91c2-4a3d-9d7c-391778978df8', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:50:38.493975 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:38.499263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:38.510261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:38.511245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:38.512345 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:38.512989 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:38.752327 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:38.789061 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:38.793012 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:38.795387 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-50d91290-a46a-4d58-9774-8e4b12930949 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.308944 Dec 13 16:50:38.810279 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 160/324] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:38 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:50:38.823121 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-89974917-0a71-4a8e-9aba-f322424e2714 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:38.825220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-89974917-0a71-4a8e-9aba-f322424e2714 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:38.851568 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-89974917-0a71-4a8e-9aba-f322424e2714 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:38.854548 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-89974917-0a71-4a8e-9aba-f322424e2714 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:38.855612 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-89974917-0a71-4a8e-9aba-f322424e2714 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:38.859702 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-89974917-0a71-4a8e-9aba-f322424e2714 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:38.984287 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-89974917-0a71-4a8e-9aba-f322424e2714 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3a05e2599149449be08cc2ed91082c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573f4507ec8f41eb938c17dc3c07cb4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:38.998074 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-89974917-0a71-4a8e-9aba-f322424e2714 tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 200 len: 1299 microversion: 2.1 time: 0.185957 Dec 13 16:50:38.998694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 161/325] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:38 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:39.008453 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-ab6eb912-764a-4d5f-af31-aa34759d7aea req-2443889d-75cc-48cc-a983-a55135d6511e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5507551-35a1-4dc3-81d7-4eda23f04070", "name": "network-vif-deleted", "tag": "22f4ecd9-4abb-481c-a85b-bfff4bfb33cf"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:39.010222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:50:39.010222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:50:39.020434 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-ab6eb912-764a-4d5f-af31-aa34759d7aea req-2443889d-75cc-48cc-a983-a55135d6511e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.021179 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-ab6eb912-764a-4d5f-af31-aa34759d7aea req-2443889d-75cc-48cc-a983-a55135d6511e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.035032 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-ab6eb912-764a-4d5f-af31-aa34759d7aea req-2443889d-75cc-48cc-a983-a55135d6511e service nova] Creating event network-vif-deleted:22f4ecd9-4abb-481c-a85b-bfff4bfb33cf for instance a5507551-35a1-4dc3-81d7-4eda23f04070 on hv-cinder-82160 Dec 13 16:50:39.041895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-ab6eb912-764a-4d5f-af31-aa34759d7aea req-2443889d-75cc-48cc-a983-a55135d6511e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042084 Dec 13 16:50:39.043556 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 162/326] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:50:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:50:39.055128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-250adc3f-e54d-4c19-a64b-96869075c9de tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:39.055943 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-250adc3f-e54d-4c19-a64b-96869075c9de tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:39.063819 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-250adc3f-e54d-4c19-a64b-96869075c9de tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.064436 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-250adc3f-e54d-4c19-a64b-96869075c9de tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.065966 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-250adc3f-e54d-4c19-a64b-96869075c9de tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.066471 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-250adc3f-e54d-4c19-a64b-96869075c9de tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.156637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:50:39.157487 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:50:39.158467 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:50:39.159407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:50:39.160360 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:50:39.185229 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.186807 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.188551 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.190865 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.224516 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Getting quotas for project a2582447f23e4d388146670235c51d91. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:50:39.232731 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Getting quotas for user 5ef49d5682214edf8f95293d0041aa85 and project a2582447f23e4d388146670235c51d91. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:50:39.254849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:50:39.266440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:50:39.330560 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-250adc3f-e54d-4c19-a64b-96869075c9de tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:39.348855 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-250adc3f-e54d-4c19-a64b-96869075c9de tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1701 microversion: 2.1 time: 0.302968 Dec 13 16:50:39.350532 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 163/327] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:39 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1701 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:39.359636 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c3f6dbef-ef90-4567-9b70-6718096d2122 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:39.361451 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c3f6dbef-ef90-4567-9b70-6718096d2122 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:39.369122 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7c602a88-14c2-47b6-8f80-2845aec3272f tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059511 Dec 13 16:50:39.372200 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 165/328] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:50:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 13 16:50:39.375608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c3f6dbef-ef90-4567-9b70-6718096d2122 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.377167 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c3f6dbef-ef90-4567-9b70-6718096d2122 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.379069 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c3f6dbef-ef90-4567-9b70-6718096d2122 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.381016 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c3f6dbef-ef90-4567-9b70-6718096d2122 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.399650 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cb7d2195-8bd1-4267-b0d4-111c46d63868 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:39.400366 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cb7d2195-8bd1-4267-b0d4-111c46d63868 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:39.486714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cb7d2195-8bd1-4267-b0d4-111c46d63868 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:39.502794 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cb7d2195-8bd1-4267-b0d4-111c46d63868 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1218 microversion: 2.1 time: 0.109677 Dec 13 16:50:39.511317 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 166/329] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:39 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:39.527698 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a57daec2-02bd-45bc-9f5c-3f82dda69de4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:39.542696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a57daec2-02bd-45bc-9f5c-3f82dda69de4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.552262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a57daec2-02bd-45bc-9f5c-3f82dda69de4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.690363 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c3f6dbef-ef90-4567-9b70-6718096d2122 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:39.725099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c3f6dbef-ef90-4567-9b70-6718096d2122 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.368125 Dec 13 16:50:39.728781 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 164/330] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:39 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:39.753508 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a57daec2-02bd-45bc-9f5c-3f82dda69de4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Going to try to start instance {{(pid=122885) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 13 16:50:39.825435 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:39.826228 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:39.838061 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.840173 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.843034 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a57daec2-02bd-45bc-9f5c-3f82dda69de4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 202 len: 0 microversion: 2.1 time: 0.329682 Dec 13 16:50:39.844693 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.845551 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.849940 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 167/331] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:39 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:50:39.859085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5964aac8-2f9b-469d-9ae0-91f370d6923a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:39.860236 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5964aac8-2f9b-469d-9ae0-91f370d6923a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:39.867269 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5964aac8-2f9b-469d-9ae0-91f370d6923a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.867846 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5964aac8-2f9b-469d-9ae0-91f370d6923a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:39.869280 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5964aac8-2f9b-469d-9ae0-91f370d6923a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:39.869920 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5964aac8-2f9b-469d-9ae0-91f370d6923a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:40.146473 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:40.154655 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5964aac8-2f9b-469d-9ae0-91f370d6923a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:40.169264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:40.171905 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:40.175645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5964aac8-2f9b-469d-9ae0-91f370d6923a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1710 microversion: 2.1 time: 0.320970 Dec 13 16:50:40.176219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 168/332] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:39 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1710 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:40.179092 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1ede35fa-6141-46d9-92e7-17627b4f8702 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.358460 Dec 13 16:50:40.179879 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 165/333] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:39 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:40.191111 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:40.191730 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] [instance: a5507551-35a1-4dc3-81d7-4eda23f04070] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:40.209894 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:40.210343 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:40.211143 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:40.211744 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:40.230454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] HTTP exception thrown: Instance a5507551-35a1-4dc3-81d7-4eda23f04070 could not be found. Dec 13 16:50:40.231058 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] Returning 404 to user: Instance a5507551-35a1-4dc3-81d7-4eda23f04070 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:50:40.231896 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1f02d190-fbdf-4f68-9314-19aa3c8c027c tempest-VolumesNegativeTest-1287366338 tempest-VolumesNegativeTest-1287366338-project] 10.222.0.62 "GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070" status: 404 len: 111 microversion: 2.1 time: 0.053859 Dec 13 16:50:40.240081 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 169/334] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:40 2021] GET /compute/v2.1/servers/a5507551-35a1-4dc3-81d7-4eda23f04070 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:50:40.531671 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4fc741e7-d729-4274-9f68-ec84d43dc72e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:40.532323 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4fc741e7-d729-4274-9f68-ec84d43dc72e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:40.547789 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4fc741e7-d729-4274-9f68-ec84d43dc72e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:40.550284 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4fc741e7-d729-4274-9f68-ec84d43dc72e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:40.552840 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4fc741e7-d729-4274-9f68-ec84d43dc72e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:40.553717 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4fc741e7-d729-4274-9f68-ec84d43dc72e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:40.657744 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4fc741e7-d729-4274-9f68-ec84d43dc72e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:40.670529 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4fc741e7-d729-4274-9f68-ec84d43dc72e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1270 microversion: 2.1 time: 0.142993 Dec 13 16:50:40.672263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 166/335] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:40 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:40.743377 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-27dfee50-f9a1-48a6-8a22-c56065b05c46 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:40.744332 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-27dfee50-f9a1-48a6-8a22-c56065b05c46 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:40.756955 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-27dfee50-f9a1-48a6-8a22-c56065b05c46 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:40.758284 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-27dfee50-f9a1-48a6-8a22-c56065b05c46 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:40.761167 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-27dfee50-f9a1-48a6-8a22-c56065b05c46 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:40.763791 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-27dfee50-f9a1-48a6-8a22-c56065b05c46 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:41.205400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-514fd566-80ac-42bd-9ff4-440be61318c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:41.208401 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-514fd566-80ac-42bd-9ff4-440be61318c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:41.230973 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-514fd566-80ac-42bd-9ff4-440be61318c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:41.231862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-514fd566-80ac-42bd-9ff4-440be61318c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:41.234638 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-514fd566-80ac-42bd-9ff4-440be61318c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:41.236445 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-514fd566-80ac-42bd-9ff4-440be61318c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:41.296393 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-27dfee50-f9a1-48a6-8a22-c56065b05c46 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:41.352340 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-27dfee50-f9a1-48a6-8a22-c56065b05c46 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1522 microversion: 2.1 time: 0.612649 Dec 13 16:50:41.367919 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 170/336] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:40 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:41.386965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:41.388623 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:41.431782 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:41.432296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:41.433227 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:41.433663 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:41.773478 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:41.792219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:41.793926 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:41.795677 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c0cf4304-67aa-4b60-8d10-7bafb4b1bbc4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.425901 Dec 13 16:50:41.796351 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 171/337] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:41 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:41.802188 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-02493497-358f-4b60-acc3-5b7b08408b83 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:41.803272 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-02493497-358f-4b60-acc3-5b7b08408b83 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:41.810612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-02493497-358f-4b60-acc3-5b7b08408b83 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:41.811510 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-02493497-358f-4b60-acc3-5b7b08408b83 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:41.812547 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-02493497-358f-4b60-acc3-5b7b08408b83 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:41.813212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-02493497-358f-4b60-acc3-5b7b08408b83 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:41.898205 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-514fd566-80ac-42bd-9ff4-440be61318c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:41.911840 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-514fd566-80ac-42bd-9ff4-440be61318c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1710 microversion: 2.1 time: 0.716976 Dec 13 16:50:41.914662 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 167/338] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:41 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1710 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:41.932646 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-02493497-358f-4b60-acc3-5b7b08408b83 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:41.946636 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-02493497-358f-4b60-acc3-5b7b08408b83 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1276 microversion: 2.1 time: 0.148971 Dec 13 16:50:41.957684 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 172/339] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:41 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:42.379793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-73c4f5e9-ab31-4113-8b22-5b3b4cde1ca1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:42.383141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-73c4f5e9-ab31-4113-8b22-5b3b4cde1ca1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:42.389645 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73c4f5e9-ab31-4113-8b22-5b3b4cde1ca1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:42.390601 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73c4f5e9-ab31-4113-8b22-5b3b4cde1ca1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:42.391686 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73c4f5e9-ab31-4113-8b22-5b3b4cde1ca1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:42.392165 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73c4f5e9-ab31-4113-8b22-5b3b4cde1ca1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:42.726776 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-73c4f5e9-ab31-4113-8b22-5b3b4cde1ca1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:42.737563 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-73c4f5e9-ab31-4113-8b22-5b3b4cde1ca1 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1502 microversion: 2.1 time: 0.366255 Dec 13 16:50:42.738943 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 168/340] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:42 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:42.756083 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7d9b9636-3372-4d89-9bfa-09dc392dff8e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:42.756895 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7d9b9636-3372-4d89-9bfa-09dc392dff8e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:42.763802 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7d9b9636-3372-4d89-9bfa-09dc392dff8e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:42.764492 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7d9b9636-3372-4d89-9bfa-09dc392dff8e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:42.765471 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7d9b9636-3372-4d89-9bfa-09dc392dff8e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:42.766045 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7d9b9636-3372-4d89-9bfa-09dc392dff8e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:42.814411 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:42.815831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:42.825917 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:42.829865 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:42.831321 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:42.832090 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:43.014478 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7d9b9636-3372-4d89-9bfa-09dc392dff8e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:43.032044 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7d9b9636-3372-4d89-9bfa-09dc392dff8e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1516 microversion: 2.1 time: 0.277639 Dec 13 16:50:43.033126 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 173/341] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:42 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1516 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:43.039121 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a357c643-c4ba-45d0-8c37-c76660ac50f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:43.039908 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a357c643-c4ba-45d0-8c37-c76660ac50f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:43.051657 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a357c643-c4ba-45d0-8c37-c76660ac50f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:43.052734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a357c643-c4ba-45d0-8c37-c76660ac50f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:43.054250 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a357c643-c4ba-45d0-8c37-c76660ac50f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:43.054989 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a357c643-c4ba-45d0-8c37-c76660ac50f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:43.231713 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:43.246302 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:43.248312 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:43.250448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8a60a599-657f-437d-9a59-de67e9ea7773 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.439821 Dec 13 16:50:43.251507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 169/342] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:42 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:50:43.268203 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-735df765-aea3-4c6d-bc95-1a2be08b2a55 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:43.269044 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-735df765-aea3-4c6d-bc95-1a2be08b2a55 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:43.281348 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-735df765-aea3-4c6d-bc95-1a2be08b2a55 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:43.285126 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-735df765-aea3-4c6d-bc95-1a2be08b2a55 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:43.286329 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-735df765-aea3-4c6d-bc95-1a2be08b2a55 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:43.286973 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-735df765-aea3-4c6d-bc95-1a2be08b2a55 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:43.376117 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a357c643-c4ba-45d0-8c37-c76660ac50f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:43.387251 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a357c643-c4ba-45d0-8c37-c76660ac50f5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1714 microversion: 2.1 time: 0.351893 Dec 13 16:50:43.391686 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 174/343] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:43 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1714 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:43.732421 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-735df765-aea3-4c6d-bc95-1a2be08b2a55 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:43.745590 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-735df765-aea3-4c6d-bc95-1a2be08b2a55 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1318 microversion: 2.1 time: 0.492612 Dec 13 16:50:43.746626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 170/344] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:43 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:44.241649 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-17fad9cc-07ec-4314-9601-3f0ba6833c10 req-af726856-eb76-4d85-95d2-18da53879bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c91027e-6f5a-48d1-b466-98e168767c58", "tag": "91cf683e-c7c5-4191-b0fc-82a6a1ceccf9"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:44.244563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:50:44.244563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:50:44.262563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-17fad9cc-07ec-4314-9601-3f0ba6833c10 req-af726856-eb76-4d85-95d2-18da53879bae service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.269743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:44.270643 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:44.273693 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-17fad9cc-07ec-4314-9601-3f0ba6833c10 req-af726856-eb76-4d85-95d2-18da53879bae service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:44.286367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.286843 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:44.287647 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.288086 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:44.307228 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-17fad9cc-07ec-4314-9601-3f0ba6833c10 req-af726856-eb76-4d85-95d2-18da53879bae service nova] Creating event network-changed:91cf683e-c7c5-4191-b0fc-82a6a1ceccf9 for instance 1c91027e-6f5a-48d1-b466-98e168767c58 on hv-cinder-82160 Dec 13 16:50:44.313371 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-17fad9cc-07ec-4314-9601-3f0ba6833c10 req-af726856-eb76-4d85-95d2-18da53879bae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076028 Dec 13 16:50:44.314575 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 175/345] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:50:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:50:44.554245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:44.575868 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:44.578838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:44.582849 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-de6f369e-4cdb-497c-a54a-bea1496acb8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.317555 Dec 13 16:50:44.586402 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 171/346] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:44 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:50:44.688900 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a97cd8b7-a531-4382-b130-67fab1079c24 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:44.690404 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a97cd8b7-a531-4382-b130-67fab1079c24 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:44.697245 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a97cd8b7-a531-4382-b130-67fab1079c24 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.698052 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a97cd8b7-a531-4382-b130-67fab1079c24 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:44.698850 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a97cd8b7-a531-4382-b130-67fab1079c24 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.699271 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a97cd8b7-a531-4382-b130-67fab1079c24 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:44.725685 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-a97cd8b7-a531-4382-b130-67fab1079c24 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lazy-loading 'flavor' on Instance uuid 93b8c803-5f08-441b-818f-a12f51820ff6 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:50:44.763679 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6af63dfd-af45-4a3f-bfdc-8b77072eeb3d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:44.764284 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6af63dfd-af45-4a3f-bfdc-8b77072eeb3d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:44.775168 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6af63dfd-af45-4a3f-bfdc-8b77072eeb3d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.775817 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6af63dfd-af45-4a3f-bfdc-8b77072eeb3d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:44.781682 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6af63dfd-af45-4a3f-bfdc-8b77072eeb3d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.784449 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6af63dfd-af45-4a3f-bfdc-8b77072eeb3d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:44.946488 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a97cd8b7-a531-4382-b130-67fab1079c24 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/action" status: 200 len: 32 microversion: 2.1 time: 0.261660 Dec 13 16:50:44.949277 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 176/347] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:50:44 2021] POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:50:44.958700 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1e05f7b1-9aa8-4325-81b7-b16d2815b311 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:44.965923 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1e05f7b1-9aa8-4325-81b7-b16d2815b311 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:44.977109 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1e05f7b1-9aa8-4325-81b7-b16d2815b311 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.980557 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1e05f7b1-9aa8-4325-81b7-b16d2815b311 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:44.982373 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1e05f7b1-9aa8-4325-81b7-b16d2815b311 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:44.983342 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1e05f7b1-9aa8-4325-81b7-b16d2815b311 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:45.123740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6af63dfd-af45-4a3f-bfdc-8b77072eeb3d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:45.141498 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6af63dfd-af45-4a3f-bfdc-8b77072eeb3d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1318 microversion: 2.1 time: 0.381405 Dec 13 16:50:45.150323 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 172/348] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:44 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:50:45.603295 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:45.603881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1e05f7b1-9aa8-4325-81b7-b16d2815b311 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:45.605075 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:45.612190 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:45.613039 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:45.614099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:45.614756 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:45.621194 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1e05f7b1-9aa8-4325-81b7-b16d2815b311 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.666419 Dec 13 16:50:45.631986 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 177/349] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:44 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:45.869669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:45.883751 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:45.885528 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:45.891977 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ec4fe3be-29bf-4f33-bcbb-cd188fdf775a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.292496 Dec 13 16:50:45.903316 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 173/350] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:45 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:46.159715 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9bc49b16-5077-45e0-9548-92a0aed1e25d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:46.160281 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9bc49b16-5077-45e0-9548-92a0aed1e25d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:46.167130 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9bc49b16-5077-45e0-9548-92a0aed1e25d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:46.167351 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9bc49b16-5077-45e0-9548-92a0aed1e25d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:46.169744 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9bc49b16-5077-45e0-9548-92a0aed1e25d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:46.169744 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9bc49b16-5077-45e0-9548-92a0aed1e25d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:46.330347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9bc49b16-5077-45e0-9548-92a0aed1e25d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:46.338818 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9bc49b16-5077-45e0-9548-92a0aed1e25d tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1318 microversion: 2.1 time: 0.184000 Dec 13 16:50:46.349627 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 178/351] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:46 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:46.639049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-29148ff7-8f61-4563-89b5-8e388d5ca404 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:46.640040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-29148ff7-8f61-4563-89b5-8e388d5ca404 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:46.648945 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-29148ff7-8f61-4563-89b5-8e388d5ca404 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:46.649930 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-29148ff7-8f61-4563-89b5-8e388d5ca404 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:46.650965 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-29148ff7-8f61-4563-89b5-8e388d5ca404 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:46.651624 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-29148ff7-8f61-4563-89b5-8e388d5ca404 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:46.858242 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-29148ff7-8f61-4563-89b5-8e388d5ca404 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:46.867120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-29148ff7-8f61-4563-89b5-8e388d5ca404 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.231930 Dec 13 16:50:46.868221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 174/352] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:46 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:46.910898 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:46.911510 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:46.922498 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:46.923033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:46.924396 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:46.925055 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:47.118942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:47.127967 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:47.129947 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:47.131644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-84ad01c4-3a6f-48c6-97b9-c5ffedc1dd23 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.224396 Dec 13 16:50:47.143425 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 179/353] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:46 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:47.355612 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-932b4e88-c904-4409-a468-084ad9c0bd59 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:47.356225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-932b4e88-c904-4409-a468-084ad9c0bd59 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:47.363417 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-932b4e88-c904-4409-a468-084ad9c0bd59 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:47.363863 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-932b4e88-c904-4409-a468-084ad9c0bd59 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:47.364697 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-932b4e88-c904-4409-a468-084ad9c0bd59 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:47.365128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-932b4e88-c904-4409-a468-084ad9c0bd59 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:47.507878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-932b4e88-c904-4409-a468-084ad9c0bd59 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:47.516704 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-932b4e88-c904-4409-a468-084ad9c0bd59 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1318 microversion: 2.1 time: 0.164813 Dec 13 16:50:47.517654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 175/354] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:47 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:47.885336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4776d33d-8bfc-4b5f-95a9-c46e29e89162 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:47.885836 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4776d33d-8bfc-4b5f-95a9-c46e29e89162 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:47.892383 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4776d33d-8bfc-4b5f-95a9-c46e29e89162 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:47.892883 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4776d33d-8bfc-4b5f-95a9-c46e29e89162 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:47.893708 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4776d33d-8bfc-4b5f-95a9-c46e29e89162 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:47.894142 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4776d33d-8bfc-4b5f-95a9-c46e29e89162 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:48.047342 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4776d33d-8bfc-4b5f-95a9-c46e29e89162 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:48.057335 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4776d33d-8bfc-4b5f-95a9-c46e29e89162 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.175709 Dec 13 16:50:48.070354 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 180/355] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:47 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:48.151465 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:48.152018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:48.159808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:48.160307 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:48.161305 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:48.161921 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:48.314034 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:48.327616 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:48.329157 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:48.330767 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-fa92cb65-7b01-43cf-ad74-a5b0f58a6c90 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.184038 Dec 13 16:50:48.331680 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 176/356] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:48 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:48.535809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3c289320-b0b7-471e-907f-b12acdfdc8c4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:48.537285 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3c289320-b0b7-471e-907f-b12acdfdc8c4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:48.544050 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3c289320-b0b7-471e-907f-b12acdfdc8c4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:48.544615 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3c289320-b0b7-471e-907f-b12acdfdc8c4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:48.545453 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3c289320-b0b7-471e-907f-b12acdfdc8c4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:48.546094 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3c289320-b0b7-471e-907f-b12acdfdc8c4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:48.724287 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3c289320-b0b7-471e-907f-b12acdfdc8c4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:48.732053 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3c289320-b0b7-471e-907f-b12acdfdc8c4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1318 microversion: 2.1 time: 0.202313 Dec 13 16:50:48.742246 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 181/357] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:48 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:49.077860 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e58730cf-9236-4598-8bb2-a639215116a2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:49.078538 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e58730cf-9236-4598-8bb2-a639215116a2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:49.088841 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e58730cf-9236-4598-8bb2-a639215116a2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:49.089317 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e58730cf-9236-4598-8bb2-a639215116a2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:49.091664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e58730cf-9236-4598-8bb2-a639215116a2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:49.091664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e58730cf-9236-4598-8bb2-a639215116a2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:49.253539 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e58730cf-9236-4598-8bb2-a639215116a2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:49.261747 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e58730cf-9236-4598-8bb2-a639215116a2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.187644 Dec 13 16:50:49.262347 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 177/358] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:49 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:49.357977 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:49.360088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:49.374911 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:49.375361 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:49.376164 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:49.376886 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:49.563367 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:49.574836 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:49.576340 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:49.577793 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7c1d102d-6b01-46d8-b3b7-4ad611439dd5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.228304 Dec 13 16:50:49.578678 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 182/359] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:49 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:49.750787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1e432c6f-5148-461c-a4ae-7a91a03415ba tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:49.751870 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1e432c6f-5148-461c-a4ae-7a91a03415ba tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:49.762793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e432c6f-5148-461c-a4ae-7a91a03415ba tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:49.763549 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e432c6f-5148-461c-a4ae-7a91a03415ba tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:49.764529 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e432c6f-5148-461c-a4ae-7a91a03415ba tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:49.765333 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e432c6f-5148-461c-a4ae-7a91a03415ba tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:49.879067 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-008976b4-b3b5-4ba0-a172-efe9a05a71cb req-826110ff-fa89-43d7-9548-b2b1a4084066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c91027e-6f5a-48d1-b466-98e168767c58", "name": "network-vif-plugged", "status": "completed", "tag": "91cf683e-c7c5-4191-b0fc-82a6a1ceccf9"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:49.882550 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:50:49.882550 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:50:49.895753 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-008976b4-b3b5-4ba0-a172-efe9a05a71cb req-826110ff-fa89-43d7-9548-b2b1a4084066 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:49.897307 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-008976b4-b3b5-4ba0-a172-efe9a05a71cb req-826110ff-fa89-43d7-9548-b2b1a4084066 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:49.944320 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-008976b4-b3b5-4ba0-a172-efe9a05a71cb req-826110ff-fa89-43d7-9548-b2b1a4084066 service nova] Creating event network-vif-plugged:91cf683e-c7c5-4191-b0fc-82a6a1ceccf9 for instance 1c91027e-6f5a-48d1-b466-98e168767c58 on hv-cinder-82160 Dec 13 16:50:49.956954 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-008976b4-b3b5-4ba0-a172-efe9a05a71cb req-826110ff-fa89-43d7-9548-b2b1a4084066 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096433 Dec 13 16:50:49.961360 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 183/360] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:50:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:50:50.001841 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1e432c6f-5148-461c-a4ae-7a91a03415ba tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:50.013136 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1e432c6f-5148-461c-a4ae-7a91a03415ba tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1318 microversion: 2.1 time: 0.266981 Dec 13 16:50:50.013829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 178/361] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:49 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:50.280434 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c64077f6-9049-4032-a24a-a1dc71f29a06 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:50.281165 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c64077f6-9049-4032-a24a-a1dc71f29a06 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:50.288376 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c64077f6-9049-4032-a24a-a1dc71f29a06 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:50.288995 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c64077f6-9049-4032-a24a-a1dc71f29a06 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:50.289660 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c64077f6-9049-4032-a24a-a1dc71f29a06 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:50.290251 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c64077f6-9049-4032-a24a-a1dc71f29a06 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:50.470009 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c64077f6-9049-4032-a24a-a1dc71f29a06 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:50.478372 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c64077f6-9049-4032-a24a-a1dc71f29a06 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.202422 Dec 13 16:50:50.478965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 184/362] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:50 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:50.596473 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:50.597133 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:50.604660 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:50.605117 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:50.605952 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:50.606386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:50.782746 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:50.791985 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:50.793538 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:50.794729 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-229a1137-78df-4219-9c25-a3735efbe1f8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1740 microversion: 2.20 time: 0.202158 Dec 13 16:50:50.795303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 179/363] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:50 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:51.033853 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2cbc4204-bd8b-4b8f-a085-5e6bb8d7fa68 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:51.034415 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2cbc4204-bd8b-4b8f-a085-5e6bb8d7fa68 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:51.040925 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cbc4204-bd8b-4b8f-a085-5e6bb8d7fa68 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:51.041362 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cbc4204-bd8b-4b8f-a085-5e6bb8d7fa68 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:51.042314 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cbc4204-bd8b-4b8f-a085-5e6bb8d7fa68 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:51.042737 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cbc4204-bd8b-4b8f-a085-5e6bb8d7fa68 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:51.303495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2cbc4204-bd8b-4b8f-a085-5e6bb8d7fa68 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:51.312007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2cbc4204-bd8b-4b8f-a085-5e6bb8d7fa68 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1318 microversion: 2.1 time: 0.282270 Dec 13 16:50:51.312726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 185/364] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:51 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:51.495862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4d53f4a9-05cc-42f8-8db3-358a45de8460 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:51.496591 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4d53f4a9-05cc-42f8-8db3-358a45de8460 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:51.503160 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d53f4a9-05cc-42f8-8db3-358a45de8460 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:51.503694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d53f4a9-05cc-42f8-8db3-358a45de8460 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:51.504583 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d53f4a9-05cc-42f8-8db3-358a45de8460 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:51.505119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d53f4a9-05cc-42f8-8db3-358a45de8460 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:51.682201 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4d53f4a9-05cc-42f8-8db3-358a45de8460 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:51.692162 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4d53f4a9-05cc-42f8-8db3-358a45de8460 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.200276 Dec 13 16:50:51.693051 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 180/365] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:51 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:51.813341 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:51.814056 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:51.821232 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:51.821664 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:51.822438 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:51.822860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:51.966081 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:51.974660 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:51.976120 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:51.977278 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-18b5fd27-d724-4cf7-b34f-c78c66fbb38a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1722 microversion: 2.20 time: 0.167836 Dec 13 16:50:51.977848 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 186/366] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:51 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:52.329935 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1174c1e2-18eb-4850-ae08-1f637ccc7f33 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:52.330795 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1174c1e2-18eb-4850-ae08-1f637ccc7f33 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:52.337297 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1174c1e2-18eb-4850-ae08-1f637ccc7f33 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:52.337741 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1174c1e2-18eb-4850-ae08-1f637ccc7f33 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:52.338522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1174c1e2-18eb-4850-ae08-1f637ccc7f33 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:52.338950 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1174c1e2-18eb-4850-ae08-1f637ccc7f33 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:52.478884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1174c1e2-18eb-4850-ae08-1f637ccc7f33 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:52.486651 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1174c1e2-18eb-4850-ae08-1f637ccc7f33 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1507 microversion: 2.1 time: 0.160632 Dec 13 16:50:52.487224 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 181/367] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:52 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:52.709666 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9fe6fcdd-fa89-42ee-98af-8294adc49cb4 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:52.710411 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9fe6fcdd-fa89-42ee-98af-8294adc49cb4 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:52.716564 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fe6fcdd-fa89-42ee-98af-8294adc49cb4 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:52.717032 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fe6fcdd-fa89-42ee-98af-8294adc49cb4 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:52.717840 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fe6fcdd-fa89-42ee-98af-8294adc49cb4 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:52.718262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fe6fcdd-fa89-42ee-98af-8294adc49cb4 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:52.871372 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9fe6fcdd-fa89-42ee-98af-8294adc49cb4 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:52.883571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9fe6fcdd-fa89-42ee-98af-8294adc49cb4 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.177120 Dec 13 16:50:52.884723 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 187/368] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:52 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:52.997340 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:52.997932 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:53.005816 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:53.006258 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:53.007030 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:53.007455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:53.154961 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:53.162553 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:53.164073 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:53.165343 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e8ecb2bf-d65a-46d7-a848-c0dd24da3842 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1722 microversion: 2.20 time: 0.172984 Dec 13 16:50:53.165896 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 182/369] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:52 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:53.905499 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5c47efe6-ca3a-4013-845d-42d0c6e9a7d2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:53.906218 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5c47efe6-ca3a-4013-845d-42d0c6e9a7d2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:53.912883 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5c47efe6-ca3a-4013-845d-42d0c6e9a7d2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:53.913318 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5c47efe6-ca3a-4013-845d-42d0c6e9a7d2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:53.914103 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5c47efe6-ca3a-4013-845d-42d0c6e9a7d2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:53.914519 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5c47efe6-ca3a-4013-845d-42d0c6e9a7d2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:54.060213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5c47efe6-ca3a-4013-845d-42d0c6e9a7d2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:54.068332 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5c47efe6-ca3a-4013-845d-42d0c6e9a7d2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.167118 Dec 13 16:50:54.068952 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 188/370] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:53 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:54.183641 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:54.184203 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:54.191771 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:54.192241 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:54.193041 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:54.193466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:54.339672 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:54.348328 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:54.349887 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:54.351033 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0ed2ec90-401f-4578-ac5e-fa789c8665ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1665 microversion: 2.20 time: 0.171351 Dec 13 16:50:54.351607 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 183/371] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:54 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:54.369085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fa0604be-f39c-43b3-9114-7811df841025 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0533098-59fa-480d-8442-7d1053d073e7"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:54.370210 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fa0604be-f39c-43b3-9114-7811df841025 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:54.377595 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fa0604be-f39c-43b3-9114-7811df841025 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:54.378051 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fa0604be-f39c-43b3-9114-7811df841025 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:54.378822 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fa0604be-f39c-43b3-9114-7811df841025 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:54.379246 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fa0604be-f39c-43b3-9114-7811df841025 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:54.699157 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fa0604be-f39c-43b3-9114-7811df841025 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333941 Dec 13 16:50:54.699884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 189/372] 10.222.0.62 () {62 vars in 1363 bytes} [Mon Dec 13 16:50:54 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:50:54.814830 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8743b3d6-0828-4608-9c44-e50215e6b64e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:54.815383 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8743b3d6-0828-4608-9c44-e50215e6b64e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:54.822688 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8743b3d6-0828-4608-9c44-e50215e6b64e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:54.823039 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8743b3d6-0828-4608-9c44-e50215e6b64e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:54.823811 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8743b3d6-0828-4608-9c44-e50215e6b64e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:54.824227 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8743b3d6-0828-4608-9c44-e50215e6b64e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:54.936746 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8743b3d6-0828-4608-9c44-e50215e6b64e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action" status: 202 len: 0 microversion: 2.20 time: 0.125550 Dec 13 16:50:54.937559 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 184/373] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:50:54 2021] POST /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:50:54.945375 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:54.946012 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:54.953423 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:54.953862 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:54.955451 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:54.955965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:55.086018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a854e2cd-4b59-4312-935b-31bb48d8c728 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:55.086624 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a854e2cd-4b59-4312-935b-31bb48d8c728 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:55.092924 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a854e2cd-4b59-4312-935b-31bb48d8c728 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:55.093367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a854e2cd-4b59-4312-935b-31bb48d8c728 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:55.094154 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a854e2cd-4b59-4312-935b-31bb48d8c728 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:55.094749 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a854e2cd-4b59-4312-935b-31bb48d8c728 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:55.116189 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:55.125590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:55.127351 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:55.132467 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-75fa7ebb-9b8d-479e-9fdc-95687a921891 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1751 microversion: 2.20 time: 0.190684 Dec 13 16:50:55.143187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 190/374] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:54 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:55.263182 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a854e2cd-4b59-4312-935b-31bb48d8c728 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:55.272045 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a854e2cd-4b59-4312-935b-31bb48d8c728 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.189651 Dec 13 16:50:55.272649 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 185/375] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:55 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:50:55.765037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-a22b1219-76df-4b3d-996f-de93a32bdf62 req-e797c70d-2607-471d-8f0a-5ffb08637bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b9554f-cedc-4ce0-a3d7-c4be33ec154f", "name": "network-vif-unplugged", "status": "completed", "tag": "b5225bcb-5258-419f-8497-ad84cf3faa1c"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:50:55.766885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:50:55.766885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:50:55.775492 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-a22b1219-76df-4b3d-996f-de93a32bdf62 req-e797c70d-2607-471d-8f0a-5ffb08637bbb service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:55.776005 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-a22b1219-76df-4b3d-996f-de93a32bdf62 req-e797c70d-2607-471d-8f0a-5ffb08637bbb service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:55.788213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.compute.server_external_events [req-a22b1219-76df-4b3d-996f-de93a32bdf62 req-e797c70d-2607-471d-8f0a-5ffb08637bbb service nova] Unable to find a host for instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f. Dropping event network-vif-unplugged {{(pid=122885) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 13 16:50:55.789516 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-a22b1219-76df-4b3d-996f-de93a32bdf62 req-e797c70d-2607-471d-8f0a-5ffb08637bbb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028209 Dec 13 16:50:55.790277 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 191/376] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:50:55 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 13 16:50:56.161486 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:56.162094 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:56.168071 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:56.168508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:56.169347 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:56.169773 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:56.289584 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-456fd170-0c3e-471f-bc44-c740c959cc58 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:56.290223 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-456fd170-0c3e-471f-bc44-c740c959cc58 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:56.296913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-456fd170-0c3e-471f-bc44-c740c959cc58 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:56.297363 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-456fd170-0c3e-471f-bc44-c740c959cc58 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:56.298437 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-456fd170-0c3e-471f-bc44-c740c959cc58 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:56.298942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-456fd170-0c3e-471f-bc44-c740c959cc58 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:56.312726 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:56.321897 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:56.323411 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:56.324779 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b634d34c-53ad-4fb5-b84b-4145a0589826 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1753 microversion: 2.20 time: 0.167542 Dec 13 16:50:56.325339 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 186/377] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:56 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:56.436229 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-456fd170-0c3e-471f-bc44-c740c959cc58 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:56.444100 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-456fd170-0c3e-471f-bc44-c740c959cc58 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.158250 Dec 13 16:50:56.444794 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 192/378] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:56 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:50:57.343482 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:57.344036 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:57.351499 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:57.351951 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:57.352782 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:57.353214 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:57.461665 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e6e7b14d-4216-4bd5-976c-7b04a78c0cf0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:57.463596 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e6e7b14d-4216-4bd5-976c-7b04a78c0cf0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:57.470108 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e6e7b14d-4216-4bd5-976c-7b04a78c0cf0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:57.470991 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e6e7b14d-4216-4bd5-976c-7b04a78c0cf0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:57.471337 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e6e7b14d-4216-4bd5-976c-7b04a78c0cf0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:57.471756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e6e7b14d-4216-4bd5-976c-7b04a78c0cf0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:57.503849 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:57.512750 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:57.514262 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:57.515476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d9acf98f-ddb1-4df6-a36a-aaff179a6ed9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.175966 Dec 13 16:50:57.516035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 187/379] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:57 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:57.628482 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e6e7b14d-4216-4bd5-976c-7b04a78c0cf0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:57.636409 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e6e7b14d-4216-4bd5-976c-7b04a78c0cf0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.178368 Dec 13 16:50:57.637035 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 193/380] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:57 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:50:58.535393 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:58.535763 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:58.542086 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:58.542527 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:58.543314 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:58.543740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:58.655005 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4dac27db-d511-4b65-b665-ea6d02132466 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:58.655882 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4dac27db-d511-4b65-b665-ea6d02132466 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:58.673636 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4dac27db-d511-4b65-b665-ea6d02132466 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:58.674165 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4dac27db-d511-4b65-b665-ea6d02132466 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:58.675131 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4dac27db-d511-4b65-b665-ea6d02132466 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:58.675768 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4dac27db-d511-4b65-b665-ea6d02132466 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:58.757106 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:58.774625 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:58.776451 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:58.777654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b99c88e1-9c18-4d3a-9b8c-f635510cd720 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.246891 Dec 13 16:50:58.778210 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 188/381] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:58 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:58.942918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4dac27db-d511-4b65-b665-ea6d02132466 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:58.953048 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4dac27db-d511-4b65-b665-ea6d02132466 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.303516 Dec 13 16:50:58.957550 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 194/382] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:58 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:50:59.797174 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:59.797851 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:59.805180 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:59.805626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:59.806394 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:59.806820 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:59.953536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:59.961916 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:59.963715 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:50:59.964900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4865e63c-b55f-4db1-86b5-1ffdb31d06ee tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.171525 Dec 13 16:50:59.965574 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 189/383] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:50:59 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:50:59.970896 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6c011d27-5ff7-4ebf-9311-f1ed5497e626 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:50:59.971515 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6c011d27-5ff7-4ebf-9311-f1ed5497e626 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:50:59.978141 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6c011d27-5ff7-4ebf-9311-f1ed5497e626 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:59.978584 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6c011d27-5ff7-4ebf-9311-f1ed5497e626 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:50:59.979359 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6c011d27-5ff7-4ebf-9311-f1ed5497e626 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:50:59.979788 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6c011d27-5ff7-4ebf-9311-f1ed5497e626 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:00.135776 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6c011d27-5ff7-4ebf-9311-f1ed5497e626 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:00.148929 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6c011d27-5ff7-4ebf-9311-f1ed5497e626 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1502 microversion: 2.1 time: 0.182237 Dec 13 16:51:00.161785 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 195/384] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:50:59 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:51:00.166699 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07bfe5fe-b2e8-462b-a007-461cf37b3e0c"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:00.167859 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:00.175427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:00.175874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:00.176774 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:00.177211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:00.202070 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] HTTP exception thrown: Cannot 'attach_volume' instance 93b8c803-5f08-441b-818f-a12f51820ff6 while it is in vm_state rescued Dec 13 16:51:00.202654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Returning 409 to user: Cannot 'attach_volume' instance 93b8c803-5f08-441b-818f-a12f51820ff6 while it is in vm_state rescued {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:51:00.203511 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e8ca6a7e-0682-422d-886a-b08dbfdf1a60 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040748 Dec 13 16:51:00.204175 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 190/385] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:51:00 2021] POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 13 16:51:00.212869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1a632dad-d774-4416-95b3-c451178be634 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:00.213391 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1a632dad-d774-4416-95b3-c451178be634 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:00.220017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1a632dad-d774-4416-95b3-c451178be634 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:00.220459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1a632dad-d774-4416-95b3-c451178be634 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:00.221567 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1a632dad-d774-4416-95b3-c451178be634 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:00.222011 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1a632dad-d774-4416-95b3-c451178be634 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:00.312646 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1a632dad-d774-4416-95b3-c451178be634 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/action" status: 202 len: 0 microversion: 2.1 time: 0.103191 Dec 13 16:51:00.313297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 196/386] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:51:00 2021] POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:51:00.321780 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-468286c3-cac6-44cc-8f51-24e34e26456a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:00.322387 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-468286c3-cac6-44cc-8f51-24e34e26456a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:00.328882 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-468286c3-cac6-44cc-8f51-24e34e26456a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:00.329951 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-468286c3-cac6-44cc-8f51-24e34e26456a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:00.330828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-468286c3-cac6-44cc-8f51-24e34e26456a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:00.331263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-468286c3-cac6-44cc-8f51-24e34e26456a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:00.502417 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-468286c3-cac6-44cc-8f51-24e34e26456a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:00.510783 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-468286c3-cac6-44cc-8f51-24e34e26456a tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.192767 Dec 13 16:51:00.511367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 191/387] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:00 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:00.987033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:00.987743 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:00.994759 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:00.995192 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:00.996049 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:00.996475 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:01.160303 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:01.169256 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:01.170715 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:01.174605 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9df0f678-77d0-44e8-b495-c703b50011c4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.191110 Dec 13 16:51:01.174605 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 197/388] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:00 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:01.529534 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-40f09afa-a6c2-4d99-8add-0fb13a69bd28 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:01.530215 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-40f09afa-a6c2-4d99-8add-0fb13a69bd28 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:01.537058 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-40f09afa-a6c2-4d99-8add-0fb13a69bd28 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:01.537498 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-40f09afa-a6c2-4d99-8add-0fb13a69bd28 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:01.538262 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-40f09afa-a6c2-4d99-8add-0fb13a69bd28 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:01.538684 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-40f09afa-a6c2-4d99-8add-0fb13a69bd28 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:01.697225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-40f09afa-a6c2-4d99-8add-0fb13a69bd28 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:01.705144 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-40f09afa-a6c2-4d99-8add-0fb13a69bd28 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.179454 Dec 13 16:51:01.715139 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 192/389] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:01 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:02.194507 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:02.195329 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:02.205090 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:02.205544 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:02.207271 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:02.207790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:02.366292 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:02.375290 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:02.377410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:02.378816 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d5243a3d-8c7c-4c54-825a-04e818a6418e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.189955 Dec 13 16:51:02.379668 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 198/390] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:02 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:51:02.725347 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-575ec272-e3c0-4118-aa58-5002b02b4441 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:02.726346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-575ec272-e3c0-4118-aa58-5002b02b4441 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:02.733684 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-575ec272-e3c0-4118-aa58-5002b02b4441 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:02.734489 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-575ec272-e3c0-4118-aa58-5002b02b4441 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:02.735282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-575ec272-e3c0-4118-aa58-5002b02b4441 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:02.735715 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-575ec272-e3c0-4118-aa58-5002b02b4441 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:02.896373 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-575ec272-e3c0-4118-aa58-5002b02b4441 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:02.904198 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-575ec272-e3c0-4118-aa58-5002b02b4441 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.184447 Dec 13 16:51:02.904796 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 193/391] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:02 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:03.400821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:03.401595 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:03.409901 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:03.410558 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:03.411670 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:03.412093 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:03.558373 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:03.568988 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:03.570656 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:03.575072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3c308ad4-f84f-4e41-b47f-bce4a2d30eed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.178807 Dec 13 16:51:03.575928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 199/392] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:03 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:03.927768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bfe47f72-f8cc-457a-8b91-75c89e277328 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:03.928880 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bfe47f72-f8cc-457a-8b91-75c89e277328 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:03.938889 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfe47f72-f8cc-457a-8b91-75c89e277328 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:03.939701 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfe47f72-f8cc-457a-8b91-75c89e277328 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:03.940900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfe47f72-f8cc-457a-8b91-75c89e277328 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:03.941458 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfe47f72-f8cc-457a-8b91-75c89e277328 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:04.089760 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bfe47f72-f8cc-457a-8b91-75c89e277328 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:04.098175 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bfe47f72-f8cc-457a-8b91-75c89e277328 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.178528 Dec 13 16:51:04.099191 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 194/393] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:03 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:04.593987 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:04.594577 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:04.600882 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:04.601322 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:04.602090 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:04.602516 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:04.744399 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:04.752612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:04.754329 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:04.755476 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e05c8e9c-1d60-42a7-86c2-2623b41fbeed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.165376 Dec 13 16:51:04.756043 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 200/394] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:04 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:05.118838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-22c40a74-f04b-4ca2-9ab1-16ae2e2d4fc8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:05.119451 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-22c40a74-f04b-4ca2-9ab1-16ae2e2d4fc8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:05.128065 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-22c40a74-f04b-4ca2-9ab1-16ae2e2d4fc8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:05.128498 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-22c40a74-f04b-4ca2-9ab1-16ae2e2d4fc8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:05.129316 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-22c40a74-f04b-4ca2-9ab1-16ae2e2d4fc8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:05.129739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-22c40a74-f04b-4ca2-9ab1-16ae2e2d4fc8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:05.297792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-22c40a74-f04b-4ca2-9ab1-16ae2e2d4fc8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:05.310521 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-22c40a74-f04b-4ca2-9ab1-16ae2e2d4fc8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.197931 Dec 13 16:51:05.312321 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 195/395] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:05 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:05.775066 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:05.775727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:05.782450 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:05.782869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:05.783809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:05.784512 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:05.941378 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:05.949860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:05.951393 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:05.952503 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a2f9ba27-066f-49d5-b282-8193a18cb00f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.181271 Dec 13 16:51:05.953213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 201/396] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:05 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:06.337250 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0be44972-da1e-49a7-8eb7-bdf4d1a5aff7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:06.338623 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0be44972-da1e-49a7-8eb7-bdf4d1a5aff7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:06.345551 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0be44972-da1e-49a7-8eb7-bdf4d1a5aff7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:06.346390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0be44972-da1e-49a7-8eb7-bdf4d1a5aff7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:06.347419 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0be44972-da1e-49a7-8eb7-bdf4d1a5aff7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:06.348066 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0be44972-da1e-49a7-8eb7-bdf4d1a5aff7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:06.503485 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0be44972-da1e-49a7-8eb7-bdf4d1a5aff7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:06.513592 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0be44972-da1e-49a7-8eb7-bdf4d1a5aff7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.185679 Dec 13 16:51:06.518138 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 196/397] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:06 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:06.971523 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:06.972175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:06.980269 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:06.980747 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:06.981528 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:06.981960 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:07.126975 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:07.135461 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:07.136988 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:07.138121 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-61efbc3c-5b34-4117-a0ce-46d62967fa36 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.170484 Dec 13 16:51:07.138713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 202/398] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:06 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:07.535092 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-fee4160c-2f0b-4643-9dd4-5c079f1ea432 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:07.535732 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-fee4160c-2f0b-4643-9dd4-5c079f1ea432 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:07.542239 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fee4160c-2f0b-4643-9dd4-5c079f1ea432 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:07.542672 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fee4160c-2f0b-4643-9dd4-5c079f1ea432 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:07.543435 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fee4160c-2f0b-4643-9dd4-5c079f1ea432 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:07.543853 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fee4160c-2f0b-4643-9dd4-5c079f1ea432 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:07.683848 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fee4160c-2f0b-4643-9dd4-5c079f1ea432 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:07.691887 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-fee4160c-2f0b-4643-9dd4-5c079f1ea432 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.160502 Dec 13 16:51:07.692403 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 197/399] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:07 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:08.157037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:08.157695 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:08.164610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:08.165037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:08.165820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:08.166248 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:08.317606 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:08.326196 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:08.327662 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:08.328818 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2b9b034d-f46b-460e-a0fe-14a2d7f73a14 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.175602 Dec 13 16:51:08.329377 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 203/400] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:08 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:08.717762 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ff2ea62f-0f7f-41b2-8367-75727794665c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:08.718410 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ff2ea62f-0f7f-41b2-8367-75727794665c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:08.725865 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff2ea62f-0f7f-41b2-8367-75727794665c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:08.726678 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff2ea62f-0f7f-41b2-8367-75727794665c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:08.727785 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff2ea62f-0f7f-41b2-8367-75727794665c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:08.728446 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff2ea62f-0f7f-41b2-8367-75727794665c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:08.870498 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ff2ea62f-0f7f-41b2-8367-75727794665c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:08.880108 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ff2ea62f-0f7f-41b2-8367-75727794665c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.165972 Dec 13 16:51:08.882414 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 198/401] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:08 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:09.348304 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:09.349063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:09.355557 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:09.356001 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:09.356809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:09.357241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:09.494441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:09.503224 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:09.505133 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:09.506279 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-707bcfc5-e08b-4972-bcce-bbd9ce1ae7f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.162006 Dec 13 16:51:09.506904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 204/402] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:09 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:09.898427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-896649fc-3e71-4d81-b185-93c99865b02f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:09.899118 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-896649fc-3e71-4d81-b185-93c99865b02f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:09.905904 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-896649fc-3e71-4d81-b185-93c99865b02f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:09.906340 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-896649fc-3e71-4d81-b185-93c99865b02f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:09.907105 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-896649fc-3e71-4d81-b185-93c99865b02f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:09.907526 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-896649fc-3e71-4d81-b185-93c99865b02f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:10.062370 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-896649fc-3e71-4d81-b185-93c99865b02f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:10.072446 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-896649fc-3e71-4d81-b185-93c99865b02f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.177942 Dec 13 16:51:10.073477 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 199/403] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:09 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:10.524957 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:10.525713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:10.532408 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:10.533182 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:10.534586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:10.535031 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:10.684119 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:10.694825 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:10.696322 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:10.697557 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-05f4a69f-1f7c-460f-8e3b-bbba259f782d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.176373 Dec 13 16:51:10.698120 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 205/404] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:10 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:11.090517 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3787f7c6-d6cb-467f-9625-b63e57ec522b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:11.091134 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3787f7c6-d6cb-467f-9625-b63e57ec522b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:11.097797 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3787f7c6-d6cb-467f-9625-b63e57ec522b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:11.098241 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3787f7c6-d6cb-467f-9625-b63e57ec522b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:11.099325 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3787f7c6-d6cb-467f-9625-b63e57ec522b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:11.099753 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3787f7c6-d6cb-467f-9625-b63e57ec522b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:11.243168 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3787f7c6-d6cb-467f-9625-b63e57ec522b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:11.251203 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3787f7c6-d6cb-467f-9625-b63e57ec522b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.164485 Dec 13 16:51:11.251780 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 200/405] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:11 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:11.716459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:11.717100 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:11.724446 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:11.724950 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:11.725933 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:11.726362 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:11.870473 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:11.884776 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:11.887139 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:11.889077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-978d8c0f-386b-4de1-945c-fca01a4a03be tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.176204 Dec 13 16:51:11.889968 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 206/406] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:11 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:12.103382 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5bf4226a-cc76-404a-8f36-723cea8e8dd4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d35f31-2c92-4f83-9c40-d4b038a07534", "device": "/dev/sdb"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:12.105032 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5bf4226a-cc76-404a-8f36-723cea8e8dd4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:12.111613 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bf4226a-cc76-404a-8f36-723cea8e8dd4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:12.112050 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bf4226a-cc76-404a-8f36-723cea8e8dd4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:12.112848 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bf4226a-cc76-404a-8f36-723cea8e8dd4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:12.113268 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bf4226a-cc76-404a-8f36-723cea8e8dd4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:12.275225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7033c33e-96c7-485f-b3ad-cb60ed3ca439 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:12.275857 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7033c33e-96c7-485f-b3ad-cb60ed3ca439 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:12.282588 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7033c33e-96c7-485f-b3ad-cb60ed3ca439 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:12.283031 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7033c33e-96c7-485f-b3ad-cb60ed3ca439 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:12.283827 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7033c33e-96c7-485f-b3ad-cb60ed3ca439 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:12.284257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7033c33e-96c7-485f-b3ad-cb60ed3ca439 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:12.422423 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7033c33e-96c7-485f-b3ad-cb60ed3ca439 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:12.430676 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7033c33e-96c7-485f-b3ad-cb60ed3ca439 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.159772 Dec 13 16:51:12.431227 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 207/407] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:12 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:12.667115 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5bf4226a-cc76-404a-8f36-723cea8e8dd4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "POST /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567395 Dec 13 16:51:12.668011 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 201/408] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:51:12 2021] POST /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:51:12.911771 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:12.912319 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:12.920121 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:12.920701 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:12.921907 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:12.922524 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:13.150236 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:13.159072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:13.160680 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:13.161920 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4d69f5f5-8271-44d1-a6a8-c968a3232d84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.254607 Dec 13 16:51:13.162559 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 208/409] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:12 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:13.457115 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ba0a6aad-fc53-4c16-bf40-974a94daea4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:13.458124 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ba0a6aad-fc53-4c16-bf40-974a94daea4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:13.466065 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ba0a6aad-fc53-4c16-bf40-974a94daea4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:13.466501 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ba0a6aad-fc53-4c16-bf40-974a94daea4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:13.467325 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ba0a6aad-fc53-4c16-bf40-974a94daea4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:13.467750 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ba0a6aad-fc53-4c16-bf40-974a94daea4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:13.604618 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ba0a6aad-fc53-4c16-bf40-974a94daea4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:13.613488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ba0a6aad-fc53-4c16-bf40-974a94daea4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.162779 Dec 13 16:51:13.614051 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 202/410] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:13 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:14.181094 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:14.181669 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:14.188734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:14.189175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:14.189947 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:14.190341 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:14.328696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:14.337711 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:14.339181 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:14.340323 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c4ab7c0d-9555-4b9d-a3a7-9f0a0a28b284 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.163575 Dec 13 16:51:14.340912 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 209/411] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:14 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:14.633832 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-781bc64a-9abb-4bcd-81ef-646a7705a7f3 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:14.634441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-781bc64a-9abb-4bcd-81ef-646a7705a7f3 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:14.641193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-781bc64a-9abb-4bcd-81ef-646a7705a7f3 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:14.641642 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-781bc64a-9abb-4bcd-81ef-646a7705a7f3 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:14.642407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-781bc64a-9abb-4bcd-81ef-646a7705a7f3 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:14.642829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-781bc64a-9abb-4bcd-81ef-646a7705a7f3 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:14.791551 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-781bc64a-9abb-4bcd-81ef-646a7705a7f3 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:14.802223 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-781bc64a-9abb-4bcd-81ef-646a7705a7f3 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1510 microversion: 2.1 time: 0.173138 Dec 13 16:51:14.802891 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 203/412] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:14 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:15.358767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:15.359347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:15.366108 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:15.366723 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:15.367880 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:15.368314 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:15.504933 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:15.513794 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:15.515275 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:15.516450 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cdea9fa9-0506-414c-aba6-7cb2eb743ec4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.161704 Dec 13 16:51:15.517066 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 210/413] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:15 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:15.824371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6d812246-1201-4ec1-a855-6e3c972aa4ec tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:15.825295 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6d812246-1201-4ec1-a855-6e3c972aa4ec tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:15.835535 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6d812246-1201-4ec1-a855-6e3c972aa4ec tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:15.835975 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6d812246-1201-4ec1-a855-6e3c972aa4ec tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:15.836794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6d812246-1201-4ec1-a855-6e3c972aa4ec tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:15.837217 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6d812246-1201-4ec1-a855-6e3c972aa4ec tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:15.977115 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6d812246-1201-4ec1-a855-6e3c972aa4ec tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:15.984869 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6d812246-1201-4ec1-a855-6e3c972aa4ec tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1516 microversion: 2.1 time: 0.166849 Dec 13 16:51:15.985438 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 204/414] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:15 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:16.535810 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:16.536585 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:16.545038 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:16.545554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:16.546412 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:16.546881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:16.714492 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:16.723342 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:16.724837 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:16.725966 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-56ae2ece-11eb-4183-b688-80151c75531a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.194658 Dec 13 16:51:16.726508 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 211/415] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:16 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:17.328126 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1e21e383-5feb-45d4-ada8-4d155f268ca2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:17.328752 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1e21e383-5feb-45d4-ada8-4d155f268ca2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:17.335210 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e21e383-5feb-45d4-ada8-4d155f268ca2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:17.335658 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e21e383-5feb-45d4-ada8-4d155f268ca2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:17.336721 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e21e383-5feb-45d4-ada8-4d155f268ca2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:17.337579 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1e21e383-5feb-45d4-ada8-4d155f268ca2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:17.470507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1e21e383-5feb-45d4-ada8-4d155f268ca2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:17.478189 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1e21e383-5feb-45d4-ada8-4d155f268ca2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1516 microversion: 2.1 time: 0.153779 Dec 13 16:51:17.478761 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 205/416] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:17 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:17.495002 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-87affa95-ac53-4b67-b6d3-29121a843611 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96a318d5-c475-497c-911a-5b246661e9f8"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:17.496056 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-87affa95-ac53-4b67-b6d3-29121a843611 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:17.502671 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-87affa95-ac53-4b67-b6d3-29121a843611 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:17.503103 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-87affa95-ac53-4b67-b6d3-29121a843611 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:17.503854 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-87affa95-ac53-4b67-b6d3-29121a843611 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:17.504281 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-87affa95-ac53-4b67-b6d3-29121a843611 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:17.745510 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:17.746106 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:17.752380 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:17.752858 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:17.753605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:17.754028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:17.767518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-87affa95-ac53-4b67-b6d3-29121a843611 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276612 Dec 13 16:51:17.769073 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 212/417] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:51:17 2021] POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:51:17.891622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:17.900211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:17.901707 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:17.902865 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-18275cfa-be82-41d1-ab4f-0ceabec998fb tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.162025 Dec 13 16:51:17.903423 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 206/418] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:17 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:51:18.922397 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:18.923155 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:18.930017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:18.930471 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:18.931313 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:18.931672 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:19.071761 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:19.081665 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:19.083163 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:19.084303 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-573307d6-86bc-4107-968c-f4cb7ff5bf77 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.166144 Dec 13 16:51:19.084885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 213/419] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:18 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:20.105157 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:20.106563 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:20.116361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:20.117391 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:20.118545 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:20.119362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:20.258068 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:20.267022 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:20.268522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:20.269701 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-609b5257-a61b-4be1-912f-535dd55e5e9e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.170330 Dec 13 16:51:20.270268 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 207/420] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:20 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:21.292188 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:21.293245 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:21.303261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:21.303936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:21.305180 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:21.305838 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:21.469441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:21.478274 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:21.479763 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:21.480978 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e0e1bde7-5d17-47ba-8542-65461f827be1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.194707 Dec 13 16:51:21.481546 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 214/421] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:21 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:22.500384 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:22.501099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:22.508326 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:22.508962 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:22.509736 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:22.510157 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:22.653560 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:22.661805 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:22.663278 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:22.664418 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-022c4f3e-541d-42bb-8a40-3c8cf6e711ec tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.169295 Dec 13 16:51:22.665018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 208/422] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:22 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:23.682520 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:23.683263 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:23.689930 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:23.690369 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:23.691142 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:23.691568 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:23.834432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:23.843625 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:23.845172 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:23.846306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-899cb19b-df2b-4cd6-a12b-7bc309e02c21 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.167902 Dec 13 16:51:23.846873 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 215/423] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:23 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:24.868354 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:24.868974 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:24.877844 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:24.878305 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:24.879187 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:24.879706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:25.024649 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:25.034208 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:25.035676 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:25.036862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-81769b6f-a015-496d-81b3-25ae94210b2a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.174817 Dec 13 16:51:25.037414 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 209/424] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:24 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:26.058007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:26.058971 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:26.069174 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:26.069772 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:26.070821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:26.071394 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:26.221392 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:26.233581 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:26.235063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:26.236235 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-89229fad-e78a-4a37-84c9-f2d577736ca0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.184459 Dec 13 16:51:26.236833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 216/425] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:26 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:27.023494 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-07cddf4a-42e4-43d1-89cb-548ecf75bbe3 req-9988ec7d-2a58-42e2-bc80-68e0ee35b22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b9554f-cedc-4ce0-a3d7-c4be33ec154f", "name": "network-vif-plugged", "status": "completed", "tag": "b5225bcb-5258-419f-8497-ad84cf3faa1c"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:27.025074 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:51:27.025074 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:51:27.034310 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-07cddf4a-42e4-43d1-89cb-548ecf75bbe3 req-9988ec7d-2a58-42e2-bc80-68e0ee35b22f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:27.034819 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-07cddf4a-42e4-43d1-89cb-548ecf75bbe3 req-9988ec7d-2a58-42e2-bc80-68e0ee35b22f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:27.047571 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-07cddf4a-42e4-43d1-89cb-548ecf75bbe3 req-9988ec7d-2a58-42e2-bc80-68e0ee35b22f service nova] Creating event network-vif-plugged:b5225bcb-5258-419f-8497-ad84cf3faa1c for instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f on hv-cinder-82160 Dec 13 16:51:27.052698 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-07cddf4a-42e4-43d1-89cb-548ecf75bbe3 req-9988ec7d-2a58-42e2-bc80-68e0ee35b22f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Dec 13 16:51:27.053303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 210/426] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:51:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:51:27.254898 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:27.255461 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:27.261949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:27.262397 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:27.263152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:27.263580 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:27.404185 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:27.413298 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:27.414778 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:27.415924 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-aa7cdf8b-4726-49b8-a2e3-0df8bef3499a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.165002 Dec 13 16:51:27.416451 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 217/427] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:27 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:28.436059 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:28.436775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:28.443329 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:28.443706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:28.444484 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:28.444942 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:28.585571 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:28.594560 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:28.596043 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:28.597295 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-cb90e932-02fc-450a-8433-d545fe68ecf5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.166303 Dec 13 16:51:28.597820 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 211/428] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:28 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:29.550144 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ee6390bb-7c18-42de-bbce-7944672ff117 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:29.551162 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ee6390bb-7c18-42de-bbce-7944672ff117 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:29.557914 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ee6390bb-7c18-42de-bbce-7944672ff117 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:29.558375 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ee6390bb-7c18-42de-bbce-7944672ff117 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:29.559284 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ee6390bb-7c18-42de-bbce-7944672ff117 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:29.559750 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ee6390bb-7c18-42de-bbce-7944672ff117 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:29.595281 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-ee6390bb-7c18-42de-bbce-7944672ff117 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lazy-loading 'flavor' on Instance uuid 93b8c803-5f08-441b-818f-a12f51820ff6 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:51:29.617476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:29.618073 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:29.625273 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:29.625687 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:29.626745 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:29.627120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:29.726108 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ee6390bb-7c18-42de-bbce-7944672ff117 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/action" status: 200 len: 32 microversion: 2.1 time: 0.179658 Dec 13 16:51:29.726726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 218/429] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:51:29 2021] POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:51:29.736142 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a1f84d63-d2e2-49ca-a571-5793be363478 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:29.736905 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a1f84d63-d2e2-49ca-a571-5793be363478 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:29.743718 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1f84d63-d2e2-49ca-a571-5793be363478 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:29.744154 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1f84d63-d2e2-49ca-a571-5793be363478 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:29.744974 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1f84d63-d2e2-49ca-a571-5793be363478 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:29.745394 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1f84d63-d2e2-49ca-a571-5793be363478 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:29.772347 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:29.780938 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:29.782445 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:29.783596 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c128e7a4-f90d-40df-ad47-d48e31d55995 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.170237 Dec 13 16:51:29.784151 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 212/430] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:29 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:29.890810 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a1f84d63-d2e2-49ca-a571-5793be363478 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:29.901090 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a1f84d63-d2e2-49ca-a571-5793be363478 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.168952 Dec 13 16:51:29.901658 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 219/431] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:29 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:30.806154 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:30.807222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:30.815621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:30.816076 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:30.816893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:30.817323 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:30.922593 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-02eac053-a697-4afa-9a5f-e80e5b164820 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:30.923309 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-02eac053-a697-4afa-9a5f-e80e5b164820 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:30.929847 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-02eac053-a697-4afa-9a5f-e80e5b164820 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:30.930323 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-02eac053-a697-4afa-9a5f-e80e5b164820 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:30.931089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-02eac053-a697-4afa-9a5f-e80e5b164820 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:30.931514 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-02eac053-a697-4afa-9a5f-e80e5b164820 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:30.954879 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:30.963387 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:30.964893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:30.966420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-51f462ee-6aab-45d2-a03c-df53c0730981 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.166346 Dec 13 16:51:30.966780 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 213/432] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:30 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:31.064711 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-02eac053-a697-4afa-9a5f-e80e5b164820 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:31.073251 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-02eac053-a697-4afa-9a5f-e80e5b164820 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.154460 Dec 13 16:51:31.073827 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 220/433] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:30 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:31.984338 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:31.985033 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:31.992336 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:31.992814 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:31.993701 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:31.994222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:32.091233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-098f6690-76e7-4840-98e0-55b73d5d778b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:32.092312 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-098f6690-76e7-4840-98e0-55b73d5d778b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:32.099724 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-098f6690-76e7-4840-98e0-55b73d5d778b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:32.100175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-098f6690-76e7-4840-98e0-55b73d5d778b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:32.101644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-098f6690-76e7-4840-98e0-55b73d5d778b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:32.102093 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-098f6690-76e7-4840-98e0-55b73d5d778b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:32.172976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:32.184244 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:32.186035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:32.187192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f9b86124-a19e-4dbe-9131-abc1270e124a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.207226 Dec 13 16:51:32.187986 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 214/434] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:31 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:32.552085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-098f6690-76e7-4840-98e0-55b73d5d778b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:32.561528 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-098f6690-76e7-4840-98e0-55b73d5d778b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.474105 Dec 13 16:51:32.562132 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 221/435] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:32 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:33.206001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:33.206676 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:33.213208 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:33.213650 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:33.214431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:33.214857 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:33.377053 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:33.386281 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:33.388387 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:33.389545 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-91ec063e-10d1-4e52-b452-61cc639b6926 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1809 microversion: 2.20 time: 0.187552 Dec 13 16:51:33.390118 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 215/436] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:33 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:33.579228 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1ff992a0-e3d3-4118-bd98-f956d432dae0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:33.579835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1ff992a0-e3d3-4118-bd98-f956d432dae0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:33.586623 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1ff992a0-e3d3-4118-bd98-f956d432dae0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:33.587071 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1ff992a0-e3d3-4118-bd98-f956d432dae0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:33.587846 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1ff992a0-e3d3-4118-bd98-f956d432dae0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:33.588279 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1ff992a0-e3d3-4118-bd98-f956d432dae0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:33.736189 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1ff992a0-e3d3-4118-bd98-f956d432dae0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:33.745036 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1ff992a0-e3d3-4118-bd98-f956d432dae0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.169761 Dec 13 16:51:33.745583 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 222/437] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:33 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:34.408952 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:34.409553 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:34.416131 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:34.416599 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:34.417439 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:34.417880 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:34.564699 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:34.576963 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:34.578451 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:34.579600 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-92c281bf-f65a-4677-a768-ff6d37936a5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1796 microversion: 2.20 time: 0.174883 Dec 13 16:51:34.580134 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 216/438] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:51:34 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1796 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:51:34.764074 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-dbcb0047-d3cd-4585-9ba1-4d4660488ed8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:34.764729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-dbcb0047-d3cd-4585-9ba1-4d4660488ed8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:34.772380 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dbcb0047-d3cd-4585-9ba1-4d4660488ed8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:34.772930 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dbcb0047-d3cd-4585-9ba1-4d4660488ed8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:34.773821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dbcb0047-d3cd-4585-9ba1-4d4660488ed8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:34.774317 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dbcb0047-d3cd-4585-9ba1-4d4660488ed8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:34.921615 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-dbcb0047-d3cd-4585-9ba1-4d4660488ed8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:34.930038 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-dbcb0047-d3cd-4585-9ba1-4d4660488ed8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.170514 Dec 13 16:51:34.930610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 223/439] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:34 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:35.954466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-264249c8-6431-47c1-80cc-ce045bcdf5ca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:35.955067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-264249c8-6431-47c1-80cc-ce045bcdf5ca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:35.961919 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-264249c8-6431-47c1-80cc-ce045bcdf5ca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:35.962368 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-264249c8-6431-47c1-80cc-ce045bcdf5ca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:35.963142 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-264249c8-6431-47c1-80cc-ce045bcdf5ca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:35.963570 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-264249c8-6431-47c1-80cc-ce045bcdf5ca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:36.106897 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-264249c8-6431-47c1-80cc-ce045bcdf5ca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:36.115452 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-264249c8-6431-47c1-80cc-ce045bcdf5ca tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.164620 Dec 13 16:51:36.116029 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 217/440] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:35 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:36.426345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7f501e01-da0a-4b6b-ba7d-262572447ac1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:36.426965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7f501e01-da0a-4b6b-ba7d-262572447ac1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:36.433686 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7f501e01-da0a-4b6b-ba7d-262572447ac1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:36.434451 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7f501e01-da0a-4b6b-ba7d-262572447ac1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:36.435017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7f501e01-da0a-4b6b-ba7d-262572447ac1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:36.435441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7f501e01-da0a-4b6b-ba7d-262572447ac1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:36.562171 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-7f501e01-da0a-4b6b-ba7d-262572447ac1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lazy-loading 'services' on Instance uuid 1c91027e-6f5a-48d1-b466-98e168767c58 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:51:36.690785 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7f501e01-da0a-4b6b-ba7d-262572447ac1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58/os-volume_attachments/f2d35f31-2c92-4f83-9c40-d4b038a07534" status: 202 len: 0 microversion: 2.1 time: 0.268043 Dec 13 16:51:36.692232 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 224/441] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:51:36 2021] DELETE /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58/os-volume_attachments/f2d35f31-2c92-4f83-9c40-d4b038a07534 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:51:37.133283 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-be153044-db56-40fd-a3af-3b685c67de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:37.133908 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-be153044-db56-40fd-a3af-3b685c67de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:37.140951 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-be153044-db56-40fd-a3af-3b685c67de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:37.141400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-be153044-db56-40fd-a3af-3b685c67de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:37.142168 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-be153044-db56-40fd-a3af-3b685c67de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:37.142595 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-be153044-db56-40fd-a3af-3b685c67de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:37.281237 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-be153044-db56-40fd-a3af-3b685c67de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:37.289599 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-be153044-db56-40fd-a3af-3b685c67de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.160041 Dec 13 16:51:37.290140 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 218/442] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:37 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:37.808409 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6290496c-008f-46c4-8340-21309e4c09f5 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:37.809017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6290496c-008f-46c4-8340-21309e4c09f5 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:37.816179 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6290496c-008f-46c4-8340-21309e4c09f5 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:37.816651 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6290496c-008f-46c4-8340-21309e4c09f5 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:37.817435 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6290496c-008f-46c4-8340-21309e4c09f5 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:37.817866 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6290496c-008f-46c4-8340-21309e4c09f5 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:37.843970 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6290496c-008f-46c4-8340-21309e4c09f5 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:51:37.927412 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6290496c-008f-46c4-8340-21309e4c09f5 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 204 len: 0 microversion: 2.1 time: 0.122943 Dec 13 16:51:37.928297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 225/443] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:51:37 2021] DELETE /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:51:37.937213 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4afee6da-1b22-4681-9a8a-b808c77481f8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:37.937822 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4afee6da-1b22-4681-9a8a-b808c77481f8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:37.944188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4afee6da-1b22-4681-9a8a-b808c77481f8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:37.944703 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4afee6da-1b22-4681-9a8a-b808c77481f8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:37.945484 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4afee6da-1b22-4681-9a8a-b808c77481f8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:37.945946 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4afee6da-1b22-4681-9a8a-b808c77481f8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:38.078177 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4afee6da-1b22-4681-9a8a-b808c77481f8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:38.086347 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4afee6da-1b22-4681-9a8a-b808c77481f8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1513 microversion: 2.1 time: 0.153679 Dec 13 16:51:38.086999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 219/444] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:37 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:38.307878 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e1762946-2d73-4f01-b073-764f3c1a526c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:38.308676 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e1762946-2d73-4f01-b073-764f3c1a526c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:38.315807 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1762946-2d73-4f01-b073-764f3c1a526c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:38.316261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1762946-2d73-4f01-b073-764f3c1a526c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:38.317079 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1762946-2d73-4f01-b073-764f3c1a526c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:38.317518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1762946-2d73-4f01-b073-764f3c1a526c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:38.456956 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e1762946-2d73-4f01-b073-764f3c1a526c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:38.465072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e1762946-2d73-4f01-b073-764f3c1a526c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.161504 Dec 13 16:51:38.465723 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 226/445] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:38 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:39.103872 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-644a2933-33db-4769-869d-263d3e8881b1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:39.104490 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-644a2933-33db-4769-869d-263d3e8881b1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:39.112034 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-644a2933-33db-4769-869d-263d3e8881b1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:39.112472 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-644a2933-33db-4769-869d-263d3e8881b1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:39.113282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-644a2933-33db-4769-869d-263d3e8881b1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:39.113709 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-644a2933-33db-4769-869d-263d3e8881b1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:39.256594 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-644a2933-33db-4769-869d-263d3e8881b1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:39.264459 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-644a2933-33db-4769-869d-263d3e8881b1 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1513 microversion: 2.1 time: 0.164338 Dec 13 16:51:39.265291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 220/446] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:39 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:39.486784 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1c08a00d-707c-4d64-83cc-0dfa6452118e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:39.487855 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1c08a00d-707c-4d64-83cc-0dfa6452118e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:39.498212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1c08a00d-707c-4d64-83cc-0dfa6452118e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:39.498736 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1c08a00d-707c-4d64-83cc-0dfa6452118e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:39.499432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1c08a00d-707c-4d64-83cc-0dfa6452118e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:39.499860 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1c08a00d-707c-4d64-83cc-0dfa6452118e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:39.653858 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1c08a00d-707c-4d64-83cc-0dfa6452118e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:39.661936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1c08a00d-707c-4d64-83cc-0dfa6452118e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.181344 Dec 13 16:51:39.662514 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 227/447] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:39 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:40.282074 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c1cf00a1-954c-43a7-878d-6046b8f8fd62 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:40.282675 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c1cf00a1-954c-43a7-878d-6046b8f8fd62 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:40.289302 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1cf00a1-954c-43a7-878d-6046b8f8fd62 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:40.289768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1cf00a1-954c-43a7-878d-6046b8f8fd62 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:40.290551 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1cf00a1-954c-43a7-878d-6046b8f8fd62 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:40.290974 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1cf00a1-954c-43a7-878d-6046b8f8fd62 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:40.430378 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c1cf00a1-954c-43a7-878d-6046b8f8fd62 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:40.438710 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c1cf00a1-954c-43a7-878d-6046b8f8fd62 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 200 len: 1513 microversion: 2.1 time: 0.160201 Dec 13 16:51:40.439231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 221/448] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:40 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:40.555694 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-92000666-d3aa-410f-b245-f9a1ce0ae4ed req-06cba21f-6b9c-47b9-85b4-800bed70ca19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c91027e-6f5a-48d1-b466-98e168767c58", "name": "network-vif-deleted", "tag": "91cf683e-c7c5-4191-b0fc-82a6a1ceccf9"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:40.558459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:51:40.558459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:51:40.567324 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-92000666-d3aa-410f-b245-f9a1ce0ae4ed req-06cba21f-6b9c-47b9-85b4-800bed70ca19 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:40.567759 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-92000666-d3aa-410f-b245-f9a1ce0ae4ed req-06cba21f-6b9c-47b9-85b4-800bed70ca19 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:40.579632 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-92000666-d3aa-410f-b245-f9a1ce0ae4ed req-06cba21f-6b9c-47b9-85b4-800bed70ca19 service nova] Creating event network-vif-deleted:91cf683e-c7c5-4191-b0fc-82a6a1ceccf9 for instance 1c91027e-6f5a-48d1-b466-98e168767c58 on hv-cinder-82160 Dec 13 16:51:40.584825 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-92000666-d3aa-410f-b245-f9a1ce0ae4ed req-06cba21f-6b9c-47b9-85b4-800bed70ca19 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033531 Dec 13 16:51:40.585452 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 228/449] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:51:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:51:40.680263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-94fb5e26-037a-4135-b644-a9ead2ab3acd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:40.681101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-94fb5e26-037a-4135-b644-a9ead2ab3acd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:40.691451 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-94fb5e26-037a-4135-b644-a9ead2ab3acd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:40.691846 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-94fb5e26-037a-4135-b644-a9ead2ab3acd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:40.692625 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-94fb5e26-037a-4135-b644-a9ead2ab3acd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:40.693067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-94fb5e26-037a-4135-b644-a9ead2ab3acd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:40.836851 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-94fb5e26-037a-4135-b644-a9ead2ab3acd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:40.845731 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-94fb5e26-037a-4135-b644-a9ead2ab3acd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.169386 Dec 13 16:51:40.846315 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 222/450] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:40 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:41.458445 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:41.459129 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: 1c91027e-6f5a-48d1-b466-98e168767c58] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:41.466314 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:41.466692 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:41.467473 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:41.467891 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:41.482570 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] HTTP exception thrown: Instance 1c91027e-6f5a-48d1-b466-98e168767c58 could not be found. Dec 13 16:51:41.483162 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Returning 404 to user: Instance 1c91027e-6f5a-48d1-b466-98e168767c58 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:51:41.483997 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f11c4650-0535-4e34-8c15-5564c8a74ffb tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58" status: 404 len: 111 microversion: 2.1 time: 0.030379 Dec 13 16:51:41.484549 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 229/451] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:41 2021] GET /compute/v2.1/servers/1c91027e-6f5a-48d1-b466-98e168767c58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:51:41.865369 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f4a46343-600b-43fe-bc33-8aa3fa9eceea tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:41.866116 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f4a46343-600b-43fe-bc33-8aa3fa9eceea tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:41.874825 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f4a46343-600b-43fe-bc33-8aa3fa9eceea tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:41.875336 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f4a46343-600b-43fe-bc33-8aa3fa9eceea tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:41.876374 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f4a46343-600b-43fe-bc33-8aa3fa9eceea tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:41.877063 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f4a46343-600b-43fe-bc33-8aa3fa9eceea tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:42.026764 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f4a46343-600b-43fe-bc33-8aa3fa9eceea tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:42.035111 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f4a46343-600b-43fe-bc33-8aa3fa9eceea tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.175137 Dec 13 16:51:42.035681 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 223/452] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:41 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:43.054279 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6bb25f9c-1973-4710-8622-585de09e906f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:43.055115 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6bb25f9c-1973-4710-8622-585de09e906f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:43.063314 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6bb25f9c-1973-4710-8622-585de09e906f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:43.063789 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6bb25f9c-1973-4710-8622-585de09e906f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:43.064698 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6bb25f9c-1973-4710-8622-585de09e906f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:43.065123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6bb25f9c-1973-4710-8622-585de09e906f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:43.213118 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6bb25f9c-1973-4710-8622-585de09e906f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:43.221095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6bb25f9c-1973-4710-8622-585de09e906f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.171716 Dec 13 16:51:43.221672 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 230/453] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:43 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:43.886000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-405255d3-0388-4c34-b958-a4278698d293 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:43.886619 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-405255d3-0388-4c34-b958-a4278698d293 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:43.894239 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-405255d3-0388-4c34-b958-a4278698d293 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:43.894239 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-405255d3-0388-4c34-b958-a4278698d293 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:43.894652 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-405255d3-0388-4c34-b958-a4278698d293 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:43.895076 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-405255d3-0388-4c34-b958-a4278698d293 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:44.021175 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-405255d3-0388-4c34-b958-a4278698d293 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lazy-loading 'services' on Instance uuid 1f2466eb-448e-4984-bf58-746c53cddaac {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:51:44.148096 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-405255d3-0388-4c34-b958-a4278698d293 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/os-volume_attachments/c2c0ce40-96f2-40b4-a3ad-c088b2fd46fe" status: 202 len: 0 microversion: 2.1 time: 0.265766 Dec 13 16:51:44.149015 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 224/454] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:51:43 2021] DELETE /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/os-volume_attachments/c2c0ce40-96f2-40b4-a3ad-c088b2fd46fe => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:51:44.239993 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-788616a5-9709-4d36-9172-13404bf9380c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:44.240606 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-788616a5-9709-4d36-9172-13404bf9380c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:44.247785 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-788616a5-9709-4d36-9172-13404bf9380c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:44.248229 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-788616a5-9709-4d36-9172-13404bf9380c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:44.249071 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-788616a5-9709-4d36-9172-13404bf9380c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:44.249479 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-788616a5-9709-4d36-9172-13404bf9380c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:44.392893 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-788616a5-9709-4d36-9172-13404bf9380c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:44.401358 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-788616a5-9709-4d36-9172-13404bf9380c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.166435 Dec 13 16:51:44.401962 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 231/455] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:44 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:45.420309 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b2dad6a9-c2e3-4aa1-a424-df5805c93995 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:45.420942 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b2dad6a9-c2e3-4aa1-a424-df5805c93995 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:45.428795 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b2dad6a9-c2e3-4aa1-a424-df5805c93995 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:45.429243 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b2dad6a9-c2e3-4aa1-a424-df5805c93995 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:45.430024 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b2dad6a9-c2e3-4aa1-a424-df5805c93995 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:45.430448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b2dad6a9-c2e3-4aa1-a424-df5805c93995 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:45.585644 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b2dad6a9-c2e3-4aa1-a424-df5805c93995 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:45.594175 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b2dad6a9-c2e3-4aa1-a424-df5805c93995 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.178104 Dec 13 16:51:45.595164 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 225/456] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:45 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:46.327419 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3ac4989f-68f5-47fb-b480-b76b0f7643dc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:46.335262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ac4989f-68f5-47fb-b480-b76b0f7643dc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:46.335701 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ac4989f-68f5-47fb-b480-b76b0f7643dc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:46.359403 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3ac4989f-68f5-47fb-b480-b76b0f7643dc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Going to try to stop instance {{(pid=122885) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 13 16:51:46.406812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3ac4989f-68f5-47fb-b480-b76b0f7643dc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 202 len: 0 microversion: 2.1 time: 0.082846 Dec 13 16:51:46.407525 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 232/457] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:51:46 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:51:46.416031 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bcee578a-ce1c-4be0-bc51-beb00364af26 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:46.416680 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bcee578a-ce1c-4be0-bc51-beb00364af26 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:46.423054 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bcee578a-ce1c-4be0-bc51-beb00364af26 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:46.423990 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bcee578a-ce1c-4be0-bc51-beb00364af26 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:46.425063 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bcee578a-ce1c-4be0-bc51-beb00364af26 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:46.425440 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bcee578a-ce1c-4be0-bc51-beb00364af26 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:46.562225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bcee578a-ce1c-4be0-bc51-beb00364af26 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:46.570567 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bcee578a-ce1c-4be0-bc51-beb00364af26 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.158287 Dec 13 16:51:46.571137 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 226/458] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:46 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:46.612227 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-da54a08d-c560-41d0-9241-ad5a0c58d964 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:46.613043 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-da54a08d-c560-41d0-9241-ad5a0c58d964 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:46.619691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-da54a08d-c560-41d0-9241-ad5a0c58d964 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:46.620129 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-da54a08d-c560-41d0-9241-ad5a0c58d964 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:46.620916 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-da54a08d-c560-41d0-9241-ad5a0c58d964 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:46.621337 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-da54a08d-c560-41d0-9241-ad5a0c58d964 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:46.780634 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-da54a08d-c560-41d0-9241-ad5a0c58d964 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:46.791069 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-da54a08d-c560-41d0-9241-ad5a0c58d964 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.182828 Dec 13 16:51:46.791649 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 233/459] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:46 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:47.587793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-24ea7cb2-be8b-4ef1-b158-df8f40ac32c9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:47.588362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-24ea7cb2-be8b-4ef1-b158-df8f40ac32c9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:47.595129 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-24ea7cb2-be8b-4ef1-b158-df8f40ac32c9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:47.595575 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-24ea7cb2-be8b-4ef1-b158-df8f40ac32c9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:47.596607 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-24ea7cb2-be8b-4ef1-b158-df8f40ac32c9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:47.597086 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-24ea7cb2-be8b-4ef1-b158-df8f40ac32c9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:47.730046 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-24ea7cb2-be8b-4ef1-b158-df8f40ac32c9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:47.738427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-24ea7cb2-be8b-4ef1-b158-df8f40ac32c9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.154397 Dec 13 16:51:47.739012 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 227/460] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:47 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:47.813743 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a3e8af62-ddf8-4bd7-a90b-331f68f8c97c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:47.814339 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a3e8af62-ddf8-4bd7-a90b-331f68f8c97c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:47.821186 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3e8af62-ddf8-4bd7-a90b-331f68f8c97c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:47.821624 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3e8af62-ddf8-4bd7-a90b-331f68f8c97c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:47.822383 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3e8af62-ddf8-4bd7-a90b-331f68f8c97c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:47.822807 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3e8af62-ddf8-4bd7-a90b-331f68f8c97c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:47.958924 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a3e8af62-ddf8-4bd7-a90b-331f68f8c97c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:47.968411 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a3e8af62-ddf8-4bd7-a90b-331f68f8c97c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.158317 Dec 13 16:51:47.969018 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 234/461] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:47 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:48.357802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 16:51:48.358013 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: Mon Dec 13 16:51:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 16:51:48.757015 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8e776a3b-fc0a-47e1-8daf-950269a5ff49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:48.757677 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8e776a3b-fc0a-47e1-8daf-950269a5ff49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:48.764310 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8e776a3b-fc0a-47e1-8daf-950269a5ff49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:48.764790 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8e776a3b-fc0a-47e1-8daf-950269a5ff49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:48.765696 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8e776a3b-fc0a-47e1-8daf-950269a5ff49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:48.766162 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8e776a3b-fc0a-47e1-8daf-950269a5ff49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:48.905052 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8e776a3b-fc0a-47e1-8daf-950269a5ff49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:48.914515 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8e776a3b-fc0a-47e1-8daf-950269a5ff49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.161621 Dec 13 16:51:48.915089 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 228/462] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:48 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:48.986620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7071739e-6746-4fe2-b31c-5eb5f5201323 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:48.987412 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7071739e-6746-4fe2-b31c-5eb5f5201323 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:48.994333 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7071739e-6746-4fe2-b31c-5eb5f5201323 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:48.994780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7071739e-6746-4fe2-b31c-5eb5f5201323 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:48.995560 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7071739e-6746-4fe2-b31c-5eb5f5201323 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:48.995991 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7071739e-6746-4fe2-b31c-5eb5f5201323 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:49.134254 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7071739e-6746-4fe2-b31c-5eb5f5201323 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:49.142359 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7071739e-6746-4fe2-b31c-5eb5f5201323 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.159528 Dec 13 16:51:49.143064 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 235/463] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:48 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:49.931654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c5032e60-cd11-4879-80cc-d6f03df59dd1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:49.932215 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c5032e60-cd11-4879-80cc-d6f03df59dd1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:49.939056 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c5032e60-cd11-4879-80cc-d6f03df59dd1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:49.939507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c5032e60-cd11-4879-80cc-d6f03df59dd1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:49.940841 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c5032e60-cd11-4879-80cc-d6f03df59dd1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:49.941271 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c5032e60-cd11-4879-80cc-d6f03df59dd1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:50.079310 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c5032e60-cd11-4879-80cc-d6f03df59dd1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:50.087622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c5032e60-cd11-4879-80cc-d6f03df59dd1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.159850 Dec 13 16:51:50.088170 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 229/464] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:49 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:50.164933 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-092f0f72-db83-4eb0-ba84-80ca8c4bb10c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:50.165483 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-092f0f72-db83-4eb0-ba84-80ca8c4bb10c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:50.172763 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-092f0f72-db83-4eb0-ba84-80ca8c4bb10c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:50.173211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-092f0f72-db83-4eb0-ba84-80ca8c4bb10c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:50.174108 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-092f0f72-db83-4eb0-ba84-80ca8c4bb10c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:50.174732 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-092f0f72-db83-4eb0-ba84-80ca8c4bb10c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:50.315781 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-092f0f72-db83-4eb0-ba84-80ca8c4bb10c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:50.323928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-092f0f72-db83-4eb0-ba84-80ca8c4bb10c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.163797 Dec 13 16:51:50.324516 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 236/465] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:50 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:50.340245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-333930517", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "be6d796d-91c2-4a3d-9d7c-391778978df8"}]}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:50.391295 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] validate_networks() for [('be6d796d-91c2-4a3d-9d7c-391778978df8', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:51:50.746448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:51:50.746856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:51:50.747312 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:51:50.747709 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:51:50.748103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:51:50.757475 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:50.757844 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:50.758681 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:50.759070 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:50.775285 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Getting quotas for project a2582447f23e4d388146670235c51d91. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:51:50.779258 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Getting quotas for user 5ef49d5682214edf8f95293d0041aa85 and project a2582447f23e4d388146670235c51d91. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:51:50.790677 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:51:50.793021 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:51:50.836597 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-eeec4cf1-ed52-458a-87b5-4a16870523de tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499966 Dec 13 16:51:50.837257 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 230/466] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:51:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:51:50.846986 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-511c0e07-88ab-4724-8c28-ced4f7f8e008 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:50.847671 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-511c0e07-88ab-4724-8c28-ced4f7f8e008 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:50.899614 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-511c0e07-88ab-4724-8c28-ced4f7f8e008 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:50.906435 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-511c0e07-88ab-4724-8c28-ced4f7f8e008 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1218 microversion: 2.1 time: 0.063165 Dec 13 16:51:50.907309 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 237/467] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:50 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:51.105133 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a4464789-c470-4a80-8353-9134cce78015 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:51.105871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a4464789-c470-4a80-8353-9134cce78015 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:51.112177 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a4464789-c470-4a80-8353-9134cce78015 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:51.113021 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a4464789-c470-4a80-8353-9134cce78015 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:51.113796 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a4464789-c470-4a80-8353-9134cce78015 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:51.114222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a4464789-c470-4a80-8353-9134cce78015 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:51.254077 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a4464789-c470-4a80-8353-9134cce78015 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:51.261951 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a4464789-c470-4a80-8353-9134cce78015 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.161011 Dec 13 16:51:51.262584 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 231/468] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:51 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:51.340968 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-27b3e7ff-eb07-4f58-9457-0bc56cdd9986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:51.341571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-27b3e7ff-eb07-4f58-9457-0bc56cdd9986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:51.348211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-27b3e7ff-eb07-4f58-9457-0bc56cdd9986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:51.348702 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-27b3e7ff-eb07-4f58-9457-0bc56cdd9986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:51.349437 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-27b3e7ff-eb07-4f58-9457-0bc56cdd9986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:51.349864 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-27b3e7ff-eb07-4f58-9457-0bc56cdd9986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:51.512442 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-27b3e7ff-eb07-4f58-9457-0bc56cdd9986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:51.527578 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-27b3e7ff-eb07-4f58-9457-0bc56cdd9986 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.190133 Dec 13 16:51:51.528172 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 238/469] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:51 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:51.923565 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-635acc07-1248-4697-9b5e-8ff1fc023217 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:51.924173 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-635acc07-1248-4697-9b5e-8ff1fc023217 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:51.932160 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-635acc07-1248-4697-9b5e-8ff1fc023217 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:51.932895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-635acc07-1248-4697-9b5e-8ff1fc023217 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:51.933673 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-635acc07-1248-4697-9b5e-8ff1fc023217 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:51.934208 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-635acc07-1248-4697-9b5e-8ff1fc023217 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:52.013547 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-635acc07-1248-4697-9b5e-8ff1fc023217 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:52.021706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-635acc07-1248-4697-9b5e-8ff1fc023217 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1288 microversion: 2.1 time: 0.101933 Dec 13 16:51:52.022281 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 232/470] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:51 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:52.279687 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-760be765-59c6-49c8-b4f5-663611238771 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:52.280294 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-760be765-59c6-49c8-b4f5-663611238771 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:52.289105 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-760be765-59c6-49c8-b4f5-663611238771 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:52.289558 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-760be765-59c6-49c8-b4f5-663611238771 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:52.290372 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-760be765-59c6-49c8-b4f5-663611238771 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:52.290803 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-760be765-59c6-49c8-b4f5-663611238771 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:52.489794 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-760be765-59c6-49c8-b4f5-663611238771 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:52.506079 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-760be765-59c6-49c8-b4f5-663611238771 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.229856 Dec 13 16:51:52.507117 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 239/471] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:52 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:51:52.546104 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a0d8b3d6-6fca-45e4-b9a7-b34c9515f345 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:52.546831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a0d8b3d6-6fca-45e4-b9a7-b34c9515f345 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:52.557476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a0d8b3d6-6fca-45e4-b9a7-b34c9515f345 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:52.557935 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a0d8b3d6-6fca-45e4-b9a7-b34c9515f345 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:52.559968 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a0d8b3d6-6fca-45e4-b9a7-b34c9515f345 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:52.563875 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a0d8b3d6-6fca-45e4-b9a7-b34c9515f345 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:52.698641 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a0d8b3d6-6fca-45e4-b9a7-b34c9515f345 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:52.706745 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a0d8b3d6-6fca-45e4-b9a7-b34c9515f345 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.164589 Dec 13 16:51:52.707330 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 233/472] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:52 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:53.038811 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fc0195b5-2d97-43cf-8571-c4808b12f1a4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:53.039414 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fc0195b5-2d97-43cf-8571-c4808b12f1a4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:53.045666 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fc0195b5-2d97-43cf-8571-c4808b12f1a4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:53.046104 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fc0195b5-2d97-43cf-8571-c4808b12f1a4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:53.046884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fc0195b5-2d97-43cf-8571-c4808b12f1a4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:53.047310 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fc0195b5-2d97-43cf-8571-c4808b12f1a4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:53.263861 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fc0195b5-2d97-43cf-8571-c4808b12f1a4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:53.272395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fc0195b5-2d97-43cf-8571-c4808b12f1a4 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1318 microversion: 2.1 time: 0.237136 Dec 13 16:51:53.273375 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 240/473] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:53 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:53.361517 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-ffa927e8-97af-4d55-9780-d771d82d1c38 req-77d83384-9ed2-4331-a447-4832ea3f7ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06c69dd-f636-4969-b1a9-6929b4dc72e7", "tag": "7b8d6f73-f800-4631-8db3-6ebd28ae606f"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:53.363466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:51:53.363466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:51:53.371014 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-ffa927e8-97af-4d55-9780-d771d82d1c38 req-77d83384-9ed2-4331-a447-4832ea3f7ac7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:53.371537 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-ffa927e8-97af-4d55-9780-d771d82d1c38 req-77d83384-9ed2-4331-a447-4832ea3f7ac7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:53.384188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-ffa927e8-97af-4d55-9780-d771d82d1c38 req-77d83384-9ed2-4331-a447-4832ea3f7ac7 service nova] Creating event network-changed:7b8d6f73-f800-4631-8db3-6ebd28ae606f for instance e06c69dd-f636-4969-b1a9-6929b4dc72e7 on hv-cinder-82160 Dec 13 16:51:53.389099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-ffa927e8-97af-4d55-9780-d771d82d1c38 req-77d83384-9ed2-4331-a447-4832ea3f7ac7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031408 Dec 13 16:51:53.389700 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 234/474] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:51:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:51:53.523920 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-07e99c00-c613-4d0a-bd78-5e284da01440 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:53.524490 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-07e99c00-c613-4d0a-bd78-5e284da01440 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:53.531209 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-07e99c00-c613-4d0a-bd78-5e284da01440 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:53.531649 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-07e99c00-c613-4d0a-bd78-5e284da01440 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:53.532431 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-07e99c00-c613-4d0a-bd78-5e284da01440 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:53.532884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-07e99c00-c613-4d0a-bd78-5e284da01440 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:53.726826 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2907cc26-68db-42b2-a583-5e6836177149 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:53.727518 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-2907cc26-68db-42b2-a583-5e6836177149 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:53.734371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2907cc26-68db-42b2-a583-5e6836177149 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:53.734851 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2907cc26-68db-42b2-a583-5e6836177149 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:53.735663 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2907cc26-68db-42b2-a583-5e6836177149 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:53.736117 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2907cc26-68db-42b2-a583-5e6836177149 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:53.793765 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-07e99c00-c613-4d0a-bd78-5e284da01440 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:53.802105 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-07e99c00-c613-4d0a-bd78-5e284da01440 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.282433 Dec 13 16:51:53.803160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 241/475] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:53 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:53.871684 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-2907cc26-68db-42b2-a583-5e6836177149 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:53.881224 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2907cc26-68db-42b2-a583-5e6836177149 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.158904 Dec 13 16:51:53.881910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 235/476] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:53 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:54.289916 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c04353d1-0911-47a1-8da5-29712a17a4d2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:54.291099 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c04353d1-0911-47a1-8da5-29712a17a4d2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:54.297234 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c04353d1-0911-47a1-8da5-29712a17a4d2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:54.297745 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c04353d1-0911-47a1-8da5-29712a17a4d2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:54.298436 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c04353d1-0911-47a1-8da5-29712a17a4d2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:54.298872 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c04353d1-0911-47a1-8da5-29712a17a4d2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:54.482306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c04353d1-0911-47a1-8da5-29712a17a4d2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:54.490508 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c04353d1-0911-47a1-8da5-29712a17a4d2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1318 microversion: 2.1 time: 0.204323 Dec 13 16:51:54.491425 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 242/477] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:54 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:54.820431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d910d253-ea87-4272-b1dc-f4af55cba605 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:54.821056 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d910d253-ea87-4272-b1dc-f4af55cba605 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:54.828037 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d910d253-ea87-4272-b1dc-f4af55cba605 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:54.828491 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d910d253-ea87-4272-b1dc-f4af55cba605 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:54.829298 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d910d253-ea87-4272-b1dc-f4af55cba605 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:54.829720 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d910d253-ea87-4272-b1dc-f4af55cba605 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:54.899285 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4fe3f237-7ab0-46b6-b6df-1d163fbffccc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:54.900748 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4fe3f237-7ab0-46b6-b6df-1d163fbffccc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:54.908151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4fe3f237-7ab0-46b6-b6df-1d163fbffccc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:54.908632 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4fe3f237-7ab0-46b6-b6df-1d163fbffccc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:54.909410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4fe3f237-7ab0-46b6-b6df-1d163fbffccc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:54.909835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4fe3f237-7ab0-46b6-b6df-1d163fbffccc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:54.986476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d910d253-ea87-4272-b1dc-f4af55cba605 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:54.994520 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d910d253-ea87-4272-b1dc-f4af55cba605 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.177742 Dec 13 16:51:54.995060 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 236/478] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:54 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:55.094679 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4fe3f237-7ab0-46b6-b6df-1d163fbffccc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:55.103127 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4fe3f237-7ab0-46b6-b6df-1d163fbffccc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.208028 Dec 13 16:51:55.104080 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 243/479] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:54 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:55.509706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4ebc8f18-40f0-4321-a790-61fbe87efc0b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:55.510556 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4ebc8f18-40f0-4321-a790-61fbe87efc0b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:55.517860 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4ebc8f18-40f0-4321-a790-61fbe87efc0b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:55.518307 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4ebc8f18-40f0-4321-a790-61fbe87efc0b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:55.519315 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4ebc8f18-40f0-4321-a790-61fbe87efc0b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:55.519945 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4ebc8f18-40f0-4321-a790-61fbe87efc0b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:55.664504 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4ebc8f18-40f0-4321-a790-61fbe87efc0b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:55.672048 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4ebc8f18-40f0-4321-a790-61fbe87efc0b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1318 microversion: 2.1 time: 0.167905 Dec 13 16:51:55.672614 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 237/480] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:55 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:56.012720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1f3e42e7-9c85-47f0-9bb0-74ce70436006 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:56.013311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1f3e42e7-9c85-47f0-9bb0-74ce70436006 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:56.020073 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f3e42e7-9c85-47f0-9bb0-74ce70436006 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:56.020684 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f3e42e7-9c85-47f0-9bb0-74ce70436006 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:56.021580 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f3e42e7-9c85-47f0-9bb0-74ce70436006 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:56.022053 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1f3e42e7-9c85-47f0-9bb0-74ce70436006 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:56.126414 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-40f40636-7ee4-438b-aa6c-8891992acd4f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:56.127028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-40f40636-7ee4-438b-aa6c-8891992acd4f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:56.133830 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-40f40636-7ee4-438b-aa6c-8891992acd4f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:56.134277 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-40f40636-7ee4-438b-aa6c-8891992acd4f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:56.135035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-40f40636-7ee4-438b-aa6c-8891992acd4f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:56.135465 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-40f40636-7ee4-438b-aa6c-8891992acd4f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:56.168235 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1f3e42e7-9c85-47f0-9bb0-74ce70436006 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:56.176016 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1f3e42e7-9c85-47f0-9bb0-74ce70436006 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.166981 Dec 13 16:51:56.177034 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 244/481] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:56 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:56.288955 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-40f40636-7ee4-438b-aa6c-8891992acd4f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:56.297234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-40f40636-7ee4-438b-aa6c-8891992acd4f tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1568 microversion: 2.1 time: 0.174709 Dec 13 16:51:56.297780 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 238/482] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:56 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:51:56.692302 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5b47beac-211a-4463-a9a7-4cc9da78a824 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:56.693326 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5b47beac-211a-4463-a9a7-4cc9da78a824 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:56.701123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b47beac-211a-4463-a9a7-4cc9da78a824 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:56.701564 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b47beac-211a-4463-a9a7-4cc9da78a824 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:56.702336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b47beac-211a-4463-a9a7-4cc9da78a824 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:56.702848 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b47beac-211a-4463-a9a7-4cc9da78a824 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:56.874680 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5b47beac-211a-4463-a9a7-4cc9da78a824 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:56.883659 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5b47beac-211a-4463-a9a7-4cc9da78a824 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1318 microversion: 2.1 time: 0.197327 Dec 13 16:51:56.884242 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 245/483] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:56 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:57.194877 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ab393cd6-c7b6-4c1d-8ca4-3c4b9be8ea5a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:57.195464 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ab393cd6-c7b6-4c1d-8ca4-3c4b9be8ea5a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:57.202369 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ab393cd6-c7b6-4c1d-8ca4-3c4b9be8ea5a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.202820 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ab393cd6-c7b6-4c1d-8ca4-3c4b9be8ea5a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.203603 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ab393cd6-c7b6-4c1d-8ca4-3c4b9be8ea5a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.204038 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ab393cd6-c7b6-4c1d-8ca4-3c4b9be8ea5a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.315364 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-19c173bc-27b7-4e79-9e5b-92e3a5fc82fa tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:57.316048 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-19c173bc-27b7-4e79-9e5b-92e3a5fc82fa tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:57.324240 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-19c173bc-27b7-4e79-9e5b-92e3a5fc82fa tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.324722 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-19c173bc-27b7-4e79-9e5b-92e3a5fc82fa tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.325535 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-19c173bc-27b7-4e79-9e5b-92e3a5fc82fa tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.325956 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-19c173bc-27b7-4e79-9e5b-92e3a5fc82fa tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.341180 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ab393cd6-c7b6-4c1d-8ca4-3c4b9be8ea5a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:57.353467 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ab393cd6-c7b6-4c1d-8ca4-3c4b9be8ea5a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.162570 Dec 13 16:51:57.354067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 239/484] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:57 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:57.470552 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-19c173bc-27b7-4e79-9e5b-92e3a5fc82fa tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:57.485720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-19c173bc-27b7-4e79-9e5b-92e3a5fc82fa tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1548 microversion: 2.1 time: 0.173997 Dec 13 16:51:57.486385 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 246/485] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:57 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:57.503988 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:57.504492 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:57.511128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.511561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.512319 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.512789 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.604453 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] HTTP exception thrown: Cannot 'detach_volume' instance 93b8c803-5f08-441b-818f-a12f51820ff6 while it is in vm_state rescued Dec 13 16:51:57.605374 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Returning 409 to user: Cannot 'detach_volume' instance 93b8c803-5f08-441b-818f-a12f51820ff6 while it is in vm_state rescued {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:51:57.606512 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5f8b3c73-e731-4ee8-86f6-ebfed26ca3c7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "DELETE /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments/96a318d5-c475-497c-911a-5b246661e9f8" status: 409 len: 152 microversion: 2.1 time: 0.106542 Dec 13 16:51:57.607146 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 240/486] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:51:57 2021] DELETE /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments/96a318d5-c475-497c-911a-5b246661e9f8 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 13 16:51:57.619004 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-71e3b598-422f-4340-8057-1f52a42e7ee0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:51:57.619769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-71e3b598-422f-4340-8057-1f52a42e7ee0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:57.629013 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-71e3b598-422f-4340-8057-1f52a42e7ee0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.629641 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-71e3b598-422f-4340-8057-1f52a42e7ee0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.630828 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-71e3b598-422f-4340-8057-1f52a42e7ee0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.631515 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-71e3b598-422f-4340-8057-1f52a42e7ee0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.702661 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-71e3b598-422f-4340-8057-1f52a42e7ee0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/action" status: 202 len: 0 microversion: 2.1 time: 0.089640 Dec 13 16:51:57.703304 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 247/487] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:51:57 2021] POST /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:51:57.713514 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-759effa9-2d26-470e-8bc0-969d04f5d760 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:57.714252 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-759effa9-2d26-470e-8bc0-969d04f5d760 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:57.720852 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-759effa9-2d26-470e-8bc0-969d04f5d760 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.721225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-759effa9-2d26-470e-8bc0-969d04f5d760 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.722052 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-759effa9-2d26-470e-8bc0-969d04f5d760 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.722565 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-759effa9-2d26-470e-8bc0-969d04f5d760 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.867315 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-759effa9-2d26-470e-8bc0-969d04f5d760 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:57.876097 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-759effa9-2d26-470e-8bc0-969d04f5d760 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1556 microversion: 2.1 time: 0.167912 Dec 13 16:51:57.876706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 241/488] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:57 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:57.905913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2a9a2d2f-644e-4b0a-9fcc-b9ae84471a91 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:57.906611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2a9a2d2f-644e-4b0a-9fcc-b9ae84471a91 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:57.913383 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2a9a2d2f-644e-4b0a-9fcc-b9ae84471a91 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.913996 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2a9a2d2f-644e-4b0a-9fcc-b9ae84471a91 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:57.914798 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2a9a2d2f-644e-4b0a-9fcc-b9ae84471a91 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:57.915230 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2a9a2d2f-644e-4b0a-9fcc-b9ae84471a91 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:58.151346 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2a9a2d2f-644e-4b0a-9fcc-b9ae84471a91 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:58.159188 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2a9a2d2f-644e-4b0a-9fcc-b9ae84471a91 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1318 microversion: 2.1 time: 0.257408 Dec 13 16:51:58.159773 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 248/489] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:57 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:58.371547 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-88d22b4d-1eeb-4b2e-8b9a-db015dce2d0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:58.372152 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-88d22b4d-1eeb-4b2e-8b9a-db015dce2d0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:58.379049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-88d22b4d-1eeb-4b2e-8b9a-db015dce2d0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:58.379498 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-88d22b4d-1eeb-4b2e-8b9a-db015dce2d0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:58.380278 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-88d22b4d-1eeb-4b2e-8b9a-db015dce2d0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:58.380746 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-88d22b4d-1eeb-4b2e-8b9a-db015dce2d0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:58.518170 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-88d22b4d-1eeb-4b2e-8b9a-db015dce2d0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:58.526567 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-88d22b4d-1eeb-4b2e-8b9a-db015dce2d0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.158979 Dec 13 16:51:58.527172 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 242/490] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:58 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:58.894136 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a814f47d-996c-491c-8683-5537bbd708cd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:58.894711 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a814f47d-996c-491c-8683-5537bbd708cd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:58.901747 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a814f47d-996c-491c-8683-5537bbd708cd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:58.902177 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a814f47d-996c-491c-8683-5537bbd708cd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:58.902949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a814f47d-996c-491c-8683-5537bbd708cd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:58.903371 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a814f47d-996c-491c-8683-5537bbd708cd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:59.039150 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a814f47d-996c-491c-8683-5537bbd708cd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:59.049469 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a814f47d-996c-491c-8683-5537bbd708cd tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1556 microversion: 2.1 time: 0.159154 Dec 13 16:51:59.050165 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 249/491] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:58 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:59.176983 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e9ab1bb5-b6e0-46af-9c93-042b20190cfd tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:59.177594 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e9ab1bb5-b6e0-46af-9c93-042b20190cfd tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:59.184282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e9ab1bb5-b6e0-46af-9c93-042b20190cfd tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:59.184931 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e9ab1bb5-b6e0-46af-9c93-042b20190cfd tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:59.185758 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e9ab1bb5-b6e0-46af-9c93-042b20190cfd tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:59.186192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e9ab1bb5-b6e0-46af-9c93-042b20190cfd tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:59.329875 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e9ab1bb5-b6e0-46af-9c93-042b20190cfd tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:59.339309 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e9ab1bb5-b6e0-46af-9c93-042b20190cfd tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1318 microversion: 2.1 time: 0.166357 Dec 13 16:51:59.339890 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 243/492] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:59 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:51:59.544908 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-dc75a8e1-e91d-4f62-a92b-58ddc674fb35 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:51:59.545583 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-dc75a8e1-e91d-4f62-a92b-58ddc674fb35 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:51:59.555957 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dc75a8e1-e91d-4f62-a92b-58ddc674fb35 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:59.556694 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dc75a8e1-e91d-4f62-a92b-58ddc674fb35 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:59.557704 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dc75a8e1-e91d-4f62-a92b-58ddc674fb35 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:51:59.558247 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dc75a8e1-e91d-4f62-a92b-58ddc674fb35 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:51:59.711440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-dc75a8e1-e91d-4f62-a92b-58ddc674fb35 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:51:59.722047 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-dc75a8e1-e91d-4f62-a92b-58ddc674fb35 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.180929 Dec 13 16:51:59.722652 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 250/493] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:51:59 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:00.069819 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-809eb1ec-fbb6-4d1f-90f0-7e865fa4b040 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:00.070658 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-809eb1ec-fbb6-4d1f-90f0-7e865fa4b040 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:00.077435 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-809eb1ec-fbb6-4d1f-90f0-7e865fa4b040 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.079712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-809eb1ec-fbb6-4d1f-90f0-7e865fa4b040 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.079712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-809eb1ec-fbb6-4d1f-90f0-7e865fa4b040 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.079712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-809eb1ec-fbb6-4d1f-90f0-7e865fa4b040 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.230246 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-809eb1ec-fbb6-4d1f-90f0-7e865fa4b040 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:00.238699 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-809eb1ec-fbb6-4d1f-90f0-7e865fa4b040 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1562 microversion: 2.1 time: 0.173157 Dec 13 16:52:00.239406 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 244/494] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:00 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:00.273688 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-abd00c33-ed2c-4cc8-a637-eb7c9638a421 req-f9e4a79d-0fc5-4aeb-8bd1-e44437c0b95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06c69dd-f636-4969-b1a9-6929b4dc72e7", "name": "network-vif-plugged", "status": "completed", "tag": "7b8d6f73-f800-4631-8db3-6ebd28ae606f"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:00.276212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:00.276212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:52:00.285229 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-abd00c33-ed2c-4cc8-a637-eb7c9638a421 req-f9e4a79d-0fc5-4aeb-8bd1-e44437c0b95f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.285683 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-abd00c33-ed2c-4cc8-a637-eb7c9638a421 req-f9e4a79d-0fc5-4aeb-8bd1-e44437c0b95f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.303563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-abd00c33-ed2c-4cc8-a637-eb7c9638a421 req-f9e4a79d-0fc5-4aeb-8bd1-e44437c0b95f service nova] Creating event network-vif-plugged:7b8d6f73-f800-4631-8db3-6ebd28ae606f for instance e06c69dd-f636-4969-b1a9-6929b4dc72e7 on hv-cinder-82160 Dec 13 16:52:00.312277 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-39badbaa-5441-4342-8ae0-c20715432ca8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:00.312815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-39badbaa-5441-4342-8ae0-c20715432ca8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:00.320718 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39badbaa-5441-4342-8ae0-c20715432ca8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.320718 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39badbaa-5441-4342-8ae0-c20715432ca8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.320718 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39badbaa-5441-4342-8ae0-c20715432ca8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.321229 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-39badbaa-5441-4342-8ae0-c20715432ca8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.322096 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-abd00c33-ed2c-4cc8-a637-eb7c9638a421 req-f9e4a79d-0fc5-4aeb-8bd1-e44437c0b95f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052684 Dec 13 16:52:00.324885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 251/495] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:52:00.357943 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e7873df2-5fa8-467e-ac9f-e334081e206b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:00.358819 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e7873df2-5fa8-467e-ac9f-e334081e206b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:00.367832 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e7873df2-5fa8-467e-ac9f-e334081e206b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.368319 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e7873df2-5fa8-467e-ac9f-e334081e206b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.369152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e7873df2-5fa8-467e-ac9f-e334081e206b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.369725 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e7873df2-5fa8-467e-ac9f-e334081e206b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.435057 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-39badbaa-5441-4342-8ae0-c20715432ca8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lazy-loading 'services' on Instance uuid 93b8c803-5f08-441b-818f-a12f51820ff6 {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:52:00.513899 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-39badbaa-5441-4342-8ae0-c20715432ca8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "DELETE /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments/96a318d5-c475-497c-911a-5b246661e9f8" status: 202 len: 0 microversion: 2.1 time: 0.205204 Dec 13 16:52:00.514724 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 245/496] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:52:00 2021] DELETE /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments/96a318d5-c475-497c-911a-5b246661e9f8 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:52:00.527874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f6d71aef-4b91-45ad-aafd-0aa9ba60de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:00.529182 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f6d71aef-4b91-45ad-aafd-0aa9ba60de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:00.536346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f6d71aef-4b91-45ad-aafd-0aa9ba60de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.537188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f6d71aef-4b91-45ad-aafd-0aa9ba60de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.538437 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f6d71aef-4b91-45ad-aafd-0aa9ba60de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.538977 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f6d71aef-4b91-45ad-aafd-0aa9ba60de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.560603 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e7873df2-5fa8-467e-ac9f-e334081e206b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:00.569416 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e7873df2-5fa8-467e-ac9f-e334081e206b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1318 microversion: 2.1 time: 0.216387 Dec 13 16:52:00.570804 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 252/497] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:00 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:52:00.577487 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f6d71aef-4b91-45ad-aafd-0aa9ba60de7e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057047 Dec 13 16:52:00.578639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 246/498] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:52:00 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:00.743743 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-28b711ed-979e-4087-a09c-3f382c797048 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:00.744370 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-28b711ed-979e-4087-a09c-3f382c797048 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:00.750642 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-28b711ed-979e-4087-a09c-3f382c797048 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.751088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-28b711ed-979e-4087-a09c-3f382c797048 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.751863 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-28b711ed-979e-4087-a09c-3f382c797048 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:00.752291 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-28b711ed-979e-4087-a09c-3f382c797048 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:00.901296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-28b711ed-979e-4087-a09c-3f382c797048 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:00.909305 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-28b711ed-979e-4087-a09c-3f382c797048 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1678 microversion: 2.1 time: 0.172319 Dec 13 16:52:00.909869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 253/499] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:00 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:01.588307 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-23a28f53-0ac1-4b13-8b67-46b7ed0649c8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:01.589049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-23a28f53-0ac1-4b13-8b67-46b7ed0649c8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:01.589773 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d45f0afc-2aff-43e3-9938-0d2dd32017c2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:01.590872 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d45f0afc-2aff-43e3-9938-0d2dd32017c2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:01.596611 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-23a28f53-0ac1-4b13-8b67-46b7ed0649c8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:01.597128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-23a28f53-0ac1-4b13-8b67-46b7ed0649c8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:01.597339 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d45f0afc-2aff-43e3-9938-0d2dd32017c2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:01.597789 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d45f0afc-2aff-43e3-9938-0d2dd32017c2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:01.597934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-23a28f53-0ac1-4b13-8b67-46b7ed0649c8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:01.598343 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-23a28f53-0ac1-4b13-8b67-46b7ed0649c8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:01.598565 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d45f0afc-2aff-43e3-9938-0d2dd32017c2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:01.598977 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d45f0afc-2aff-43e3-9938-0d2dd32017c2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:01.633633 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d45f0afc-2aff-43e3-9938-0d2dd32017c2 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047917 Dec 13 16:52:01.634220 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 254/500] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:52:01 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 16:52:01.772851 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-23a28f53-0ac1-4b13-8b67-46b7ed0649c8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:01.789953 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-23a28f53-0ac1-4b13-8b67-46b7ed0649c8 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1318 microversion: 2.1 time: 0.204304 Dec 13 16:52:01.798465 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 247/501] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:01 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:01.927649 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e2e58884-6a56-476b-b62f-1e150c136844 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:01.928244 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e2e58884-6a56-476b-b62f-1e150c136844 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:01.934707 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e2e58884-6a56-476b-b62f-1e150c136844 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:01.935872 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e2e58884-6a56-476b-b62f-1e150c136844 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:01.936790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e2e58884-6a56-476b-b62f-1e150c136844 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:01.937225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e2e58884-6a56-476b-b62f-1e150c136844 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:02.084406 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e2e58884-6a56-476b-b62f-1e150c136844 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:02.103797 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e2e58884-6a56-476b-b62f-1e150c136844 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1655 microversion: 2.1 time: 0.178369 Dec 13 16:52:02.104389 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 255/502] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:01 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1655 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:02.120971 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0592da67-6ce5-4291-ba00-9d9afbd0db1f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:02.127393 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0592da67-6ce5-4291-ba00-9d9afbd0db1f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:02.127832 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0592da67-6ce5-4291-ba00-9d9afbd0db1f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:02.149550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0592da67-6ce5-4291-ba00-9d9afbd0db1f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Going to try to start instance {{(pid=122886) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 13 16:52:02.193591 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0592da67-6ce5-4291-ba00-9d9afbd0db1f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action" status: 202 len: 0 microversion: 2.1 time: 0.076478 Dec 13 16:52:02.194598 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 248/503] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:52:02 2021] POST /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:52:02.206586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-bbbd704b-df1c-4915-ab34-5055c5a07726 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:02.207653 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-bbbd704b-df1c-4915-ab34-5055c5a07726 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:02.215026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bbbd704b-df1c-4915-ab34-5055c5a07726 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:02.215669 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bbbd704b-df1c-4915-ab34-5055c5a07726 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:02.216555 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bbbd704b-df1c-4915-ab34-5055c5a07726 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:02.217013 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bbbd704b-df1c-4915-ab34-5055c5a07726 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:02.664831 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-bbbd704b-df1c-4915-ab34-5055c5a07726 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:02.672914 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-bbbd704b-df1c-4915-ab34-5055c5a07726 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1664 microversion: 2.1 time: 0.473514 Dec 13 16:52:02.673491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 256/504] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:02 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1664 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:02.811406 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-17768ef4-dcdf-4545-98f5-41be60fc83f2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:02.812477 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-17768ef4-dcdf-4545-98f5-41be60fc83f2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:02.819672 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-17768ef4-dcdf-4545-98f5-41be60fc83f2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:02.820139 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-17768ef4-dcdf-4545-98f5-41be60fc83f2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:02.820981 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-17768ef4-dcdf-4545-98f5-41be60fc83f2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:02.821395 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-17768ef4-dcdf-4545-98f5-41be60fc83f2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:02.981743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-17768ef4-dcdf-4545-98f5-41be60fc83f2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:02.995249 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-17768ef4-dcdf-4545-98f5-41be60fc83f2 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1507 microversion: 2.1 time: 0.188206 Dec 13 16:52:02.995971 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 249/505] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:02 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:03.020841 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f6f8ca94-cba8-41fe-afd3-21025cf2af9b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de23db52-c141-4813-bbe9-059718cb7ce2", "device": "/dev/sdb"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:03.022586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f6f8ca94-cba8-41fe-afd3-21025cf2af9b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:03.032076 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f6f8ca94-cba8-41fe-afd3-21025cf2af9b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:03.032654 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f6f8ca94-cba8-41fe-afd3-21025cf2af9b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:03.033525 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f6f8ca94-cba8-41fe-afd3-21025cf2af9b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:03.034033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f6f8ca94-cba8-41fe-afd3-21025cf2af9b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:03.290628 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f6f8ca94-cba8-41fe-afd3-21025cf2af9b tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "POST /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273611 Dec 13 16:52:03.291232 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 257/506] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:52:03 2021] POST /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:03.691626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c918d5a5-8e76-425f-8659-1ebfddfd3b4d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:03.692378 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c918d5a5-8e76-425f-8659-1ebfddfd3b4d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:03.698444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c918d5a5-8e76-425f-8659-1ebfddfd3b4d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:03.698960 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c918d5a5-8e76-425f-8659-1ebfddfd3b4d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:03.699745 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c918d5a5-8e76-425f-8659-1ebfddfd3b4d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:03.700271 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c918d5a5-8e76-425f-8659-1ebfddfd3b4d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:03.843999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c918d5a5-8e76-425f-8659-1ebfddfd3b4d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:03.851675 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c918d5a5-8e76-425f-8659-1ebfddfd3b4d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1664 microversion: 2.1 time: 0.164096 Dec 13 16:52:03.852250 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 250/507] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:03 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:52:04.010114 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3621429f-d82a-4c97-917b-3d254e29ed43 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:04.010834 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3621429f-d82a-4c97-917b-3d254e29ed43 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:04.020894 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3621429f-d82a-4c97-917b-3d254e29ed43 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:04.021252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3621429f-d82a-4c97-917b-3d254e29ed43 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:04.022014 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3621429f-d82a-4c97-917b-3d254e29ed43 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:04.022444 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3621429f-d82a-4c97-917b-3d254e29ed43 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:04.048360 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3621429f-d82a-4c97-917b-3d254e29ed43 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:52:04.142325 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3621429f-d82a-4c97-917b-3d254e29ed43 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 204 len: 0 microversion: 2.1 time: 0.136833 Dec 13 16:52:04.142947 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 258/508] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:52:04 2021] DELETE /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:52:04.151518 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-845e724c-5cd6-489e-84c4-d106a908505b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:04.152176 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-845e724c-5cd6-489e-84c4-d106a908505b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:04.159261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-845e724c-5cd6-489e-84c4-d106a908505b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:04.159752 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-845e724c-5cd6-489e-84c4-d106a908505b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:04.160540 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-845e724c-5cd6-489e-84c4-d106a908505b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:04.160991 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-845e724c-5cd6-489e-84c4-d106a908505b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:04.299226 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-845e724c-5cd6-489e-84c4-d106a908505b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:04.307998 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-845e724c-5cd6-489e-84c4-d106a908505b tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1508 microversion: 2.1 time: 0.160416 Dec 13 16:52:04.308716 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 251/509] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:04 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:04.874602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-42054b7d-3af7-42a5-9808-ebf7eaf4c4aa tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:04.875742 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-42054b7d-3af7-42a5-9808-ebf7eaf4c4aa tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:04.886365 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42054b7d-3af7-42a5-9808-ebf7eaf4c4aa tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:04.887168 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42054b7d-3af7-42a5-9808-ebf7eaf4c4aa tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:04.888808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42054b7d-3af7-42a5-9808-ebf7eaf4c4aa tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:04.889405 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42054b7d-3af7-42a5-9808-ebf7eaf4c4aa tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:05.040849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-42054b7d-3af7-42a5-9808-ebf7eaf4c4aa tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:05.049024 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-42054b7d-3af7-42a5-9808-ebf7eaf4c4aa tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1668 microversion: 2.1 time: 0.181374 Dec 13 16:52:05.049602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 259/510] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:04 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:05.330267 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-581b2e82-6745-4cff-83a6-66a5fb0fc8b7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:05.331302 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-581b2e82-6745-4cff-83a6-66a5fb0fc8b7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:05.341980 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-581b2e82-6745-4cff-83a6-66a5fb0fc8b7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:05.342428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-581b2e82-6745-4cff-83a6-66a5fb0fc8b7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:05.343218 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-581b2e82-6745-4cff-83a6-66a5fb0fc8b7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:05.343649 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-581b2e82-6745-4cff-83a6-66a5fb0fc8b7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:05.483035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-581b2e82-6745-4cff-83a6-66a5fb0fc8b7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:05.490831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-581b2e82-6745-4cff-83a6-66a5fb0fc8b7 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1508 microversion: 2.1 time: 0.166996 Dec 13 16:52:05.491569 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 252/511] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:05 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:06.508210 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5ad93163-7493-4b52-bff4-546b6d266fa5 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:06.508915 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5ad93163-7493-4b52-bff4-546b6d266fa5 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:06.515754 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5ad93163-7493-4b52-bff4-546b6d266fa5 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:06.516285 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5ad93163-7493-4b52-bff4-546b6d266fa5 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:06.517098 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5ad93163-7493-4b52-bff4-546b6d266fa5 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:06.517553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5ad93163-7493-4b52-bff4-546b6d266fa5 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:06.658081 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5ad93163-7493-4b52-bff4-546b6d266fa5 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:06.666022 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5ad93163-7493-4b52-bff4-546b6d266fa5 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1508 microversion: 2.1 time: 0.161487 Dec 13 16:52:06.666599 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 260/512] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:06 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:07.150891 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-4a072c88-10c1-4381-b09e-5b01ddccc504 req-6042aa18-ab84-4d86-afea-16c83f7d8b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a3c922-a3b0-41ee-9726-aa3a38dd5143", "name": "network-vif-deleted", "tag": "7a766edc-50c5-4f38-bfbd-5f1cb04e48a8"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:07.153211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:07.153211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:52:07.161888 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-4a072c88-10c1-4381-b09e-5b01ddccc504 req-6042aa18-ab84-4d86-afea-16c83f7d8b6c service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:07.162606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-4a072c88-10c1-4381-b09e-5b01ddccc504 req-6042aa18-ab84-4d86-afea-16c83f7d8b6c service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:07.174376 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-4a072c88-10c1-4381-b09e-5b01ddccc504 req-6042aa18-ab84-4d86-afea-16c83f7d8b6c service nova] Creating event network-vif-deleted:7a766edc-50c5-4f38-bfbd-5f1cb04e48a8 for instance a9a3c922-a3b0-41ee-9726-aa3a38dd5143 on hv-cinder-82160 Dec 13 16:52:07.180403 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-4a072c88-10c1-4381-b09e-5b01ddccc504 req-6042aa18-ab84-4d86-afea-16c83f7d8b6c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032920 Dec 13 16:52:07.181251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 253/513] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:07.683419 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:07.684049 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:07.690946 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:07.691606 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:07.692559 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:07.693028 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:07.725881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:07.726620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:07.727048 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lazy-loading 'fault' on Instance uuid a9a3c922-a3b0-41ee-9726-aa3a38dd5143 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:52:07.767161 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:07.774242 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d4ecd0ff-49f9-4712-a3bb-bc60db58c643 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 200 len: 1312 microversion: 2.1 time: 0.094488 Dec 13 16:52:07.774738 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 261/514] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:07 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:08.799055 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:08.799729 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: a9a3c922-a3b0-41ee-9726-aa3a38dd5143] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:08.806456 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:08.806903 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:08.807675 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:08.808101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:08.821865 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] HTTP exception thrown: Instance a9a3c922-a3b0-41ee-9726-aa3a38dd5143 could not be found. Dec 13 16:52:08.822442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Returning 404 to user: Instance a9a3c922-a3b0-41ee-9726-aa3a38dd5143 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:08.823246 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a5e043d1-843e-4986-b1ad-de952abbcaeb tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143" status: 404 len: 111 microversion: 2.1 time: 0.031321 Dec 13 16:52:08.823766 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 254/515] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:08 2021] GET /compute/v2.1/servers/a9a3c922-a3b0-41ee-9726-aa3a38dd5143 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:52:08.834551 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5aae6dd1-a9dc-41be-86e7-5c146362a71c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:08.835054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5aae6dd1-a9dc-41be-86e7-5c146362a71c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:08.844512 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5aae6dd1-a9dc-41be-86e7-5c146362a71c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:08.845068 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5aae6dd1-a9dc-41be-86e7-5c146362a71c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:08.846154 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5aae6dd1-a9dc-41be-86e7-5c146362a71c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:08.846662 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5aae6dd1-a9dc-41be-86e7-5c146362a71c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:08.874918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5aae6dd1-a9dc-41be-86e7-5c146362a71c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:52:08.960261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5aae6dd1-a9dc-41be-86e7-5c146362a71c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "DELETE /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 204 len: 0 microversion: 2.1 time: 0.131367 Dec 13 16:52:08.960970 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 262/516] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:52:08 2021] DELETE /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:52:08.970461 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5d226040-b971-4eda-9158-65844131b9cc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:08.971069 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5d226040-b971-4eda-9158-65844131b9cc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:08.977121 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d226040-b971-4eda-9158-65844131b9cc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:08.977563 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d226040-b971-4eda-9158-65844131b9cc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:08.978336 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d226040-b971-4eda-9158-65844131b9cc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:08.978757 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d226040-b971-4eda-9158-65844131b9cc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:09.122126 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-5d226040-b971-4eda-9158-65844131b9cc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:09.130437 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5d226040-b971-4eda-9158-65844131b9cc tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.165212 Dec 13 16:52:09.130973 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 255/517] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:08 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:10.147960 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c7f5fbb5-423b-4653-82ae-9445e80f0e4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:10.148646 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c7f5fbb5-423b-4653-82ae-9445e80f0e4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:10.155493 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c7f5fbb5-423b-4653-82ae-9445e80f0e4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:10.156519 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c7f5fbb5-423b-4653-82ae-9445e80f0e4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:10.156856 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c7f5fbb5-423b-4653-82ae-9445e80f0e4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:10.157328 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c7f5fbb5-423b-4653-82ae-9445e80f0e4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:10.298309 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c7f5fbb5-423b-4653-82ae-9445e80f0e4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:10.308928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c7f5fbb5-423b-4653-82ae-9445e80f0e4c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.164638 Dec 13 16:52:10.309840 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 263/518] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:10 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:11.333368 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ecaebd1a-10fa-40cd-b163-6cf0f92d7cd0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:11.334359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ecaebd1a-10fa-40cd-b163-6cf0f92d7cd0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:11.343307 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ecaebd1a-10fa-40cd-b163-6cf0f92d7cd0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:11.343905 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ecaebd1a-10fa-40cd-b163-6cf0f92d7cd0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:11.345201 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ecaebd1a-10fa-40cd-b163-6cf0f92d7cd0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:11.345635 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ecaebd1a-10fa-40cd-b163-6cf0f92d7cd0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:11.495447 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ecaebd1a-10fa-40cd-b163-6cf0f92d7cd0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:11.503791 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ecaebd1a-10fa-40cd-b163-6cf0f92d7cd0 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.175548 Dec 13 16:52:11.504355 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 256/519] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:11 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:12.527558 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1d8de140-6c15-4c0f-86b0-7bd12abb36e8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:12.528258 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1d8de140-6c15-4c0f-86b0-7bd12abb36e8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:12.535239 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d8de140-6c15-4c0f-86b0-7bd12abb36e8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:12.535854 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d8de140-6c15-4c0f-86b0-7bd12abb36e8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:12.536781 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d8de140-6c15-4c0f-86b0-7bd12abb36e8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:12.537252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d8de140-6c15-4c0f-86b0-7bd12abb36e8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:12.685683 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1d8de140-6c15-4c0f-86b0-7bd12abb36e8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:12.698099 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1d8de140-6c15-4c0f-86b0-7bd12abb36e8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.175379 Dec 13 16:52:12.702151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 264/520] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:12 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:52:13.721262 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9fd984fd-98e3-4579-a52f-8ae35119538c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:13.722024 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9fd984fd-98e3-4579-a52f-8ae35119538c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:13.728859 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9fd984fd-98e3-4579-a52f-8ae35119538c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:13.729312 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9fd984fd-98e3-4579-a52f-8ae35119538c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:13.730089 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9fd984fd-98e3-4579-a52f-8ae35119538c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:13.730526 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9fd984fd-98e3-4579-a52f-8ae35119538c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:13.873100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9fd984fd-98e3-4579-a52f-8ae35119538c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:13.882885 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9fd984fd-98e3-4579-a52f-8ae35119538c tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.167928 Dec 13 16:52:13.883450 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 257/521] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:13 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:14.903315 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5c964f4f-5029-459a-a153-bf5229009855 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:14.903918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5c964f4f-5029-459a-a153-bf5229009855 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:14.910424 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5c964f4f-5029-459a-a153-bf5229009855 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:14.910880 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5c964f4f-5029-459a-a153-bf5229009855 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:14.911645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5c964f4f-5029-459a-a153-bf5229009855 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:14.912070 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5c964f4f-5029-459a-a153-bf5229009855 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:15.132252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5c964f4f-5029-459a-a153-bf5229009855 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:15.140456 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5c964f4f-5029-459a-a153-bf5229009855 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1522 microversion: 2.1 time: 0.240892 Dec 13 16:52:15.141478 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 265/522] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:14 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:15.452737 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-a4a85f9b-78b1-459f-87d7-39f48bc3d232 req-18f25947-eca9-4acb-93bb-a591108c9f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b8c803-5f08-441b-818f-a12f51820ff6", "name": "network-vif-deleted", "tag": "b4f82f85-2cbf-4114-b796-a84807314de2"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:15.454233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:15.454233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:52:15.462310 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-a4a85f9b-78b1-459f-87d7-39f48bc3d232 req-18f25947-eca9-4acb-93bb-a591108c9f97 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:15.462737 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-a4a85f9b-78b1-459f-87d7-39f48bc3d232 req-18f25947-eca9-4acb-93bb-a591108c9f97 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:15.474909 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-a4a85f9b-78b1-459f-87d7-39f48bc3d232 req-18f25947-eca9-4acb-93bb-a591108c9f97 service nova] Creating event network-vif-deleted:b4f82f85-2cbf-4114-b796-a84807314de2 for instance 93b8c803-5f08-441b-818f-a12f51820ff6 on hv-cinder-82160 Dec 13 16:52:15.479874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-a4a85f9b-78b1-459f-87d7-39f48bc3d232 req-18f25947-eca9-4acb-93bb-a591108c9f97 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030936 Dec 13 16:52:15.480449 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 258/523] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:16.164618 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c61d016b-7f6b-4057-bc46-6c30213066d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:16.165527 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c61d016b-7f6b-4057-bc46-6c30213066d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:16.176241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c61d016b-7f6b-4057-bc46-6c30213066d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:16.176775 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c61d016b-7f6b-4057-bc46-6c30213066d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:16.177553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c61d016b-7f6b-4057-bc46-6c30213066d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:16.177981 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c61d016b-7f6b-4057-bc46-6c30213066d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:16.247118 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c61d016b-7f6b-4057-bc46-6c30213066d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:16.255425 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c61d016b-7f6b-4057-bc46-6c30213066d8 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1480 microversion: 2.1 time: 0.098565 Dec 13 16:52:16.256002 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 266/524] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:16 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1480 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:17.273706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9f1e39b4-6c0d-4890-ac67-b882c28a0fe9 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:17.274411 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9f1e39b4-6c0d-4890-ac67-b882c28a0fe9 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:17.281022 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9f1e39b4-6c0d-4890-ac67-b882c28a0fe9 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:17.281456 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9f1e39b4-6c0d-4890-ac67-b882c28a0fe9 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:17.282231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9f1e39b4-6c0d-4890-ac67-b882c28a0fe9 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:17.282653 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9f1e39b4-6c0d-4890-ac67-b882c28a0fe9 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:17.352027 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9f1e39b4-6c0d-4890-ac67-b882c28a0fe9 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:17.362124 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9f1e39b4-6c0d-4890-ac67-b882c28a0fe9 tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1306 microversion: 2.1 time: 0.092639 Dec 13 16:52:17.362793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 259/525] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:17 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:18.385154 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:18.385921 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:18.393756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:18.394199 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:18.395342 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:18.395858 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:18.435851 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:18.436386 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:18.436961 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lazy-loading 'fault' on Instance uuid 93b8c803-5f08-441b-818f-a12f51820ff6 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:52:18.482907 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b84b9ba4894db6985fcf9da882f56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0bde5e0af14db49800fbdb92510291', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:18.495681 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-43ac3819-2a39-4f92-a7bc-0663e407737e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 200 len: 1311 microversion: 2.1 time: 0.115220 Dec 13 16:52:18.496486 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 267/526] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:18 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:19.513401 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:19.514008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] [instance: 93b8c803-5f08-441b-818f-a12f51820ff6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:19.521261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:19.521732 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:19.522590 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:19.523033 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:19.537197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] HTTP exception thrown: Instance 93b8c803-5f08-441b-818f-a12f51820ff6 could not be found. Dec 13 16:52:19.537791 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] Returning 404 to user: Instance 93b8c803-5f08-441b-818f-a12f51820ff6 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:19.538651 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3dac6151-4404-4953-ab59-fa91a28ab27e tempest-ServerRescueNegativeTestJSON-1872952449 tempest-ServerRescueNegativeTestJSON-1872952449-project] 10.222.0.62 "GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6" status: 404 len: 111 microversion: 2.1 time: 0.029029 Dec 13 16:52:19.539209 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 260/527] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:19 2021] GET /compute/v2.1/servers/93b8c803-5f08-441b-818f-a12f51820ff6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:52:22.641875 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2779e44a-7e61-444a-bc86-eb6260983491 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:22.642465 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2779e44a-7e61-444a-bc86-eb6260983491 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:22.649739 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2779e44a-7e61-444a-bc86-eb6260983491 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:22.650195 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2779e44a-7e61-444a-bc86-eb6260983491 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:22.651216 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2779e44a-7e61-444a-bc86-eb6260983491 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:22.651645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2779e44a-7e61-444a-bc86-eb6260983491 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:22.734571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-2779e44a-7e61-444a-bc86-eb6260983491 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lazy-loading 'services' on Instance uuid e06c69dd-f636-4969-b1a9-6929b4dc72e7 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:52:22.810482 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2779e44a-7e61-444a-bc86-eb6260983491 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7/os-volume_attachments/de23db52-c141-4813-bbe9-059718cb7ce2" status: 202 len: 0 microversion: 2.1 time: 0.172114 Dec 13 16:52:22.811495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 268/528] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:52:22 2021] DELETE /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7/os-volume_attachments/de23db52-c141-4813-bbe9-059718cb7ce2 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:52:22.853177 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c89947bb-cf5d-4275-bf74-0fc52e48d6f2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:22.853794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c89947bb-cf5d-4275-bf74-0fc52e48d6f2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:22.861021 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c89947bb-cf5d-4275-bf74-0fc52e48d6f2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:22.865327 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c89947bb-cf5d-4275-bf74-0fc52e48d6f2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:22.865327 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c89947bb-cf5d-4275-bf74-0fc52e48d6f2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:22.865327 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c89947bb-cf5d-4275-bf74-0fc52e48d6f2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:22.900064 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c89947bb-cf5d-4275-bf74-0fc52e48d6f2 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments/c0533098-59fa-480d-8442-7d1053d073e7" status: 200 len: 194 microversion: 2.20 time: 0.050886 Dec 13 16:52:22.900873 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 261/529] 10.222.0.62 () {60 vars in 1453 bytes} [Mon Dec 13 16:52:22 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments/c0533098-59fa-480d-8442-7d1053d073e7 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:52:22.970437 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f41229c4-5dcc-493a-a68f-fb241cbaddb0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:22.971109 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f41229c4-5dcc-493a-a68f-fb241cbaddb0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:22.977756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f41229c4-5dcc-493a-a68f-fb241cbaddb0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:22.978192 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f41229c4-5dcc-493a-a68f-fb241cbaddb0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:22.979007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f41229c4-5dcc-493a-a68f-fb241cbaddb0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:22.979435 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f41229c4-5dcc-493a-a68f-fb241cbaddb0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:23.068370 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-f41229c4-5dcc-493a-a68f-fb241cbaddb0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lazy-loading 'services' on Instance uuid 49b9554f-cedc-4ce0-a3d7-c4be33ec154f {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:52:23.144407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f41229c4-5dcc-493a-a68f-fb241cbaddb0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments/c0533098-59fa-480d-8442-7d1053d073e7" status: 202 len: 0 microversion: 2.20 time: 0.177501 Dec 13 16:52:23.148687 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 269/530] 10.222.0.62 () {60 vars in 1456 bytes} [Mon Dec 13 16:52:22 2021] DELETE /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments/c0533098-59fa-480d-8442-7d1053d073e7 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:52:23.155225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-203f3068-b1ac-4bba-9ca8-c951e80fd17e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:23.156137 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-203f3068-b1ac-4bba-9ca8-c951e80fd17e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:23.162744 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-203f3068-b1ac-4bba-9ca8-c951e80fd17e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:23.163334 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-203f3068-b1ac-4bba-9ca8-c951e80fd17e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:23.164192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-203f3068-b1ac-4bba-9ca8-c951e80fd17e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:23.164736 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-203f3068-b1ac-4bba-9ca8-c951e80fd17e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:23.204813 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-203f3068-b1ac-4bba-9ca8-c951e80fd17e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054516 Dec 13 16:52:23.209546 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 262/531] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Dec 13 16:52:23 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:52:23.931555 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-17b18f18-c821-4c77-ba3f-dd022403736e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:23.932147 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-17b18f18-c821-4c77-ba3f-dd022403736e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:23.938954 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17b18f18-c821-4c77-ba3f-dd022403736e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:23.939402 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17b18f18-c821-4c77-ba3f-dd022403736e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:23.940367 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17b18f18-c821-4c77-ba3f-dd022403736e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:23.940891 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17b18f18-c821-4c77-ba3f-dd022403736e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:23.968620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-17b18f18-c821-4c77-ba3f-dd022403736e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:52:24.054410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-17b18f18-c821-4c77-ba3f-dd022403736e tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 204 len: 0 microversion: 2.1 time: 0.127407 Dec 13 16:52:24.055145 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 270/532] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:52:23 2021] DELETE /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:52:24.063666 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-501951ba-c758-4e43-b1f8-3e5a01bd78e9 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:24.064419 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-501951ba-c758-4e43-b1f8-3e5a01bd78e9 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:24.072002 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-501951ba-c758-4e43-b1f8-3e5a01bd78e9 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:24.073093 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-501951ba-c758-4e43-b1f8-3e5a01bd78e9 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:24.073661 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-501951ba-c758-4e43-b1f8-3e5a01bd78e9 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:24.074245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-501951ba-c758-4e43-b1f8-3e5a01bd78e9 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:24.214606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-501951ba-c758-4e43-b1f8-3e5a01bd78e9 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:24.223442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-501951ba-c758-4e43-b1f8-3e5a01bd78e9 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1513 microversion: 2.1 time: 0.163682 Dec 13 16:52:24.224180 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 263/533] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:24 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:52:24.238050 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6f4b235f-d043-47a7-9c62-ac6ee555852d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:24.239056 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6f4b235f-d043-47a7-9c62-ac6ee555852d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:24.246522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6f4b235f-d043-47a7-9c62-ac6ee555852d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:24.247112 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6f4b235f-d043-47a7-9c62-ac6ee555852d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:24.248100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6f4b235f-d043-47a7-9c62-ac6ee555852d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:24.248590 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6f4b235f-d043-47a7-9c62-ac6ee555852d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:24.283847 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6f4b235f-d043-47a7-9c62-ac6ee555852d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057825 Dec 13 16:52:24.284829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 264/534] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Dec 13 16:52:24 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:52:24.349804 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a89d2194-e253-4641-a29f-c69477099f64 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Action: 'create', calling method: .version_select at 0x7f21480129d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-95286524"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:24.645429 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a89d2194-e253-4641-a29f-c69477099f64 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.457811 Dec 13 16:52:24.651965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 271/535] 10.222.0.62 () {60 vars in 1154 bytes} [Mon Dec 13 16:52:24 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 460 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 13 16:52:24.657188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-08684639-8365-4aa1-b1e8-5cab20013a50 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f2148b56820>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:24.707509 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-08684639-8365-4aa1-b1e8-5cab20013a50 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64" status: 200 len: 343 microversion: 2.1 time: 0.053784 Dec 13 16:52:24.708092 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 265/536] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:52:24 2021] GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64 => generated 343 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:25.241963 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0ea91912-345d-436d-bcfb-f544e6daf749 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:25.242691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0ea91912-345d-436d-bcfb-f544e6daf749 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:25.249994 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0ea91912-345d-436d-bcfb-f544e6daf749 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:25.250432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0ea91912-345d-436d-bcfb-f544e6daf749 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:25.251249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0ea91912-345d-436d-bcfb-f544e6daf749 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:25.251663 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0ea91912-345d-436d-bcfb-f544e6daf749 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:25.296342 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-65b5c1ae-ec13-41ca-929d-dba04b785d9f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:25.297283 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-65b5c1ae-ec13-41ca-929d-dba04b785d9f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:25.305059 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-65b5c1ae-ec13-41ca-929d-dba04b785d9f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:25.305496 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-65b5c1ae-ec13-41ca-929d-dba04b785d9f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:25.306282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-65b5c1ae-ec13-41ca-929d-dba04b785d9f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:25.306702 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-65b5c1ae-ec13-41ca-929d-dba04b785d9f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:25.337552 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-65b5c1ae-ec13-41ca-929d-dba04b785d9f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045426 Dec 13 16:52:25.338144 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 266/537] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Dec 13 16:52:25 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:25.397191 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-671d70f9-478c-47b5-80b2-386e27b5de91 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:25.397691 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-671d70f9-478c-47b5-80b2-386e27b5de91 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:25.398763 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-0ea91912-345d-436d-bcfb-f544e6daf749 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:25.403844 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-671d70f9-478c-47b5-80b2-386e27b5de91 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:25.404304 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-671d70f9-478c-47b5-80b2-386e27b5de91 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:25.405117 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-671d70f9-478c-47b5-80b2-386e27b5de91 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:25.405541 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-671d70f9-478c-47b5-80b2-386e27b5de91 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:25.407012 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0ea91912-345d-436d-bcfb-f544e6daf749 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1513 microversion: 2.1 time: 0.169549 Dec 13 16:52:25.407587 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 272/538] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:25 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:25.431332 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-671d70f9-478c-47b5-80b2-386e27b5de91 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:52:25.513120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-671d70f9-478c-47b5-80b2-386e27b5de91 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 204 len: 0 microversion: 2.20 time: 0.119378 Dec 13 16:52:25.513960 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 267/539] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Dec 13 16:52:25 2021] DELETE /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 13 16:52:25.525474 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:25.526794 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:25.537997 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:25.538446 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:25.539250 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:25.539810 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:25.679803 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:25.687983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:25.689529 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:25.690861 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-45c29f4a-ea96-4951-8f09-bc5fdb4fe70d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.171726 Dec 13 16:52:25.691428 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 273/540] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:25 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:25.720741 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-14ef07ce-d6f2-40ec-9414-20b851ce6206 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f2148b56820>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:25.771412 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-14ef07ce-d6f2-40ec-9414-20b851ce6206 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64" status: 200 len: 344 microversion: 2.1 time: 0.054874 Dec 13 16:52:25.771987 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 268/541] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:52:25 2021] GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:25.784635 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e16bc580-eb19-4799-80c8-80de0ef7065c tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Action: 'create', calling method: .version_select at 0x7f21481ac4c0>, body: {"snapshot": {"volume_id": "bd3d2074-9de9-458f-9857-e4c1416f8f64", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-455405121"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:25.940714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e16bc580-eb19-4799-80c8-80de0ef7065c tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.159684 Dec 13 16:52:25.948192 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 274/542] 10.222.0.62 () {60 vars in 1161 bytes} [Mon Dec 13 16:52:25 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:25.958952 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8d8af19b-652d-453e-9b1f-6bf745767b86 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f21480611f0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:25.995364 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8d8af19b-652d-453e-9b1f-6bf745767b86 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421" status: 200 len: 286 microversion: 2.1 time: 0.040881 Dec 13 16:52:25.995910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 269/543] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 13 16:52:25 2021] GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:26.005804 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-03a426a5-6bd7-4c40-a911-40b7ea02c03f tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f2148012790>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:26.036481 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-03a426a5-6bd7-4c40-a911-40b7ea02c03f tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034542 Dec 13 16:52:26.037075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 275/544] 10.222.0.62 () {58 vars in 1139 bytes} [Mon Dec 13 16:52:26 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:52:26.047132 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-36f8968c-436c-41e1-8ca1-76aebcb79512 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f2148072ca0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:26.079012 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-36f8968c-436c-41e1-8ca1-76aebcb79512 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421" status: 200 len: 286 microversion: 2.1 time: 0.035390 Dec 13 16:52:26.079591 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 270/545] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 13 16:52:26 2021] GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:52:26.287627 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-d7f5a640-9672-4104-9503-776bd488a59f req-e65cb75f-a583-47ec-8137-230e3b2b1100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06c69dd-f636-4969-b1a9-6929b4dc72e7", "name": "network-vif-deleted", "tag": "7b8d6f73-f800-4631-8db3-6ebd28ae606f"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:26.290148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:26.290148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:52:26.297301 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-d7f5a640-9672-4104-9503-776bd488a59f req-e65cb75f-a583-47ec-8137-230e3b2b1100 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:26.297737 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-d7f5a640-9672-4104-9503-776bd488a59f req-e65cb75f-a583-47ec-8137-230e3b2b1100 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:26.309973 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-d7f5a640-9672-4104-9503-776bd488a59f req-e65cb75f-a583-47ec-8137-230e3b2b1100 service nova] Creating event network-vif-deleted:7b8d6f73-f800-4631-8db3-6ebd28ae606f for instance e06c69dd-f636-4969-b1a9-6929b4dc72e7 on hv-cinder-82160 Dec 13 16:52:26.315016 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-d7f5a640-9672-4104-9503-776bd488a59f req-e65cb75f-a583-47ec-8137-230e3b2b1100 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 Dec 13 16:52:26.316553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 276/546] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:26.424460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-03b93f77-e5d9-400e-8311-e8b007ed3293 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:26.425882 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-03b93f77-e5d9-400e-8311-e8b007ed3293 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:26.432444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-03b93f77-e5d9-400e-8311-e8b007ed3293 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:26.432920 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-03b93f77-e5d9-400e-8311-e8b007ed3293 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:26.433698 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-03b93f77-e5d9-400e-8311-e8b007ed3293 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:26.434135 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-03b93f77-e5d9-400e-8311-e8b007ed3293 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:26.497634 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-03b93f77-e5d9-400e-8311-e8b007ed3293 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:26.506386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-03b93f77-e5d9-400e-8311-e8b007ed3293 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1471 microversion: 2.1 time: 0.086105 Dec 13 16:52:26.506969 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 271/547] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:26 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1471 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:26.709857 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:26.710699 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:26.717765 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:26.718201 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:26.718980 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:26.719400 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:26.857341 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:26.866406 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:26.867903 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:26.869106 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0f1139f5-305c-43d1-91eb-99f0d4fb6b30 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.163556 Dec 13 16:52:26.869673 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 277/548] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:26 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:27.092318 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-46a9d2c4-11be-4874-8d10-da0fabca8c11 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f2148072310>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:27.124828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-46a9d2c4-11be-4874-8d10-da0fabca8c11 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421" status: 200 len: 286 microversion: 2.1 time: 0.037273 Dec 13 16:52:27.125403 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 272/549] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 13 16:52:27 2021] GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:27.524140 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5b6e7cf4-fe13-47d6-ac91-e6898107fd4a tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:27.524797 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5b6e7cf4-fe13-47d6-ac91-e6898107fd4a tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:27.531735 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b6e7cf4-fe13-47d6-ac91-e6898107fd4a tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:27.532179 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b6e7cf4-fe13-47d6-ac91-e6898107fd4a tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:27.532995 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b6e7cf4-fe13-47d6-ac91-e6898107fd4a tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:27.533426 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b6e7cf4-fe13-47d6-ac91-e6898107fd4a tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:27.594143 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5b6e7cf4-fe13-47d6-ac91-e6898107fd4a tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:27.602739 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5b6e7cf4-fe13-47d6-ac91-e6898107fd4a tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1303 microversion: 2.1 time: 0.082296 Dec 13 16:52:27.603344 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 278/550] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:27 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:27.888707 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:27.889290 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:27.896183 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:27.896619 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:27.897429 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:27.897840 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:28.037700 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:28.046372 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:28.047859 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:28.049051 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-97a5157b-2d91-4098-9992-376dc4f9e645 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.164711 Dec 13 16:52:28.049618 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 273/551] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:27 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:28.137417 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-df572fe9-50a2-4d4a-a2c0-0a2d65dd917d tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f214809a790>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:28.167484 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-df572fe9-50a2-4d4a-a2c0-0a2d65dd917d tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421" status: 200 len: 286 microversion: 2.1 time: 0.033648 Dec 13 16:52:28.168051 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 279/552] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 13 16:52:28 2021] GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:28.620392 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8b0aec31-e326-44ac-855c-f333f811e9ef tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:28.621043 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8b0aec31-e326-44ac-855c-f333f811e9ef tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:28.628922 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b0aec31-e326-44ac-855c-f333f811e9ef tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:28.629371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b0aec31-e326-44ac-855c-f333f811e9ef tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:28.630163 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b0aec31-e326-44ac-855c-f333f811e9ef tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:28.630588 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b0aec31-e326-44ac-855c-f333f811e9ef tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:28.691163 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8b0aec31-e326-44ac-855c-f333f811e9ef tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef49d5682214edf8f95293d0041aa85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2582447f23e4d388146670235c51d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:28.699386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8b0aec31-e326-44ac-855c-f333f811e9ef tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 200 len: 1303 microversion: 2.1 time: 0.082678 Dec 13 16:52:28.700025 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 274/553] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:28 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:29.068671 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:29.069300 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:29.076075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:29.076519 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:29.077332 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:29.077738 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:29.179450 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-55c02742-61fc-4082-b527-bde8c600a562 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f214801df70>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:29.210119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-55c02742-61fc-4082-b527-bde8c600a562 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421" status: 200 len: 287 microversion: 2.1 time: 0.034204 Dec 13 16:52:29.210693 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 275/554] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 13 16:52:29 2021] GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:52:29.221386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-dc710728-1b52-4772-bce0-db3b95dd4157 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f2148055ca0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:29.230384 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:29.239967 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:29.241486 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:29.242650 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2852fdcc-1978-470f-93d2-1d09dd6317fa tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.178428 Dec 13 16:52:29.243212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 280/555] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:29 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:29.289018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-dc710728-1b52-4772-bce0-db3b95dd4157 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421" status: 202 len: 0 microversion: 2.1 time: 0.071199 Dec 13 16:52:29.289610 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 276/556] 10.222.0.62 () {58 vars in 1253 bytes} [Mon Dec 13 16:52:29 2021] DELETE /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:52:29.297730 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1e4145e5-ddc7-4bd5-b3a7-bafe562ea22d tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f214810a9d0>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:29.328841 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1e4145e5-ddc7-4bd5-b3a7-bafe562ea22d tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421" status: 200 len: 286 microversion: 2.1 time: 0.034700 Dec 13 16:52:29.329592 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 281/557] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 13 16:52:29 2021] GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:29.716763 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:29.717404 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] [instance: e06c69dd-f636-4969-b1a9-6929b4dc72e7] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:29.726386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:29.726827 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:29.727606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:29.728030 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:29.742616 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] HTTP exception thrown: Instance e06c69dd-f636-4969-b1a9-6929b4dc72e7 could not be found. Dec 13 16:52:29.743209 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] Returning 404 to user: Instance e06c69dd-f636-4969-b1a9-6929b4dc72e7 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:29.744099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1c5a0447-c407-4b71-af9e-0df1119ab599 tempest-VolumesSnapshotTestJSON-703191516 tempest-VolumesSnapshotTestJSON-703191516-project] 10.222.0.62 "GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7" status: 404 len: 111 microversion: 2.1 time: 0.031093 Dec 13 16:52:29.744696 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 277/558] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:29 2021] GET /compute/v2.1/servers/e06c69dd-f636-4969-b1a9-6929b4dc72e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:52:30.261143 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:30.261715 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:30.267817 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:30.268336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:30.269414 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:30.269842 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:30.344684 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ac67244e-d09e-4653-95cf-0d667c71dcd3 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f214801db80>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:30.377725 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-ac67244e-d09e-4653-95cf-0d667c71dcd3 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] HTTP exception thrown: Snapshot fbdb652b-d4d7-4229-964b-76ff8059c421 could not be found. Dec 13 16:52:30.378696 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ac67244e-d09e-4653-95cf-0d667c71dcd3 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Returning 404 to user: Snapshot fbdb652b-d4d7-4229-964b-76ff8059c421 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:30.379837 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ac67244e-d09e-4653-95cf-0d667c71dcd3 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421" status: 404 len: 111 microversion: 2.1 time: 0.039782 Dec 13 16:52:30.380644 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 278/559] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 13 16:52:30 2021] GET /compute/v2.1/os-snapshots/fbdb652b-d4d7-4229-964b-76ff8059c421 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:52:30.389624 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d3f1a16d-ee67-4a85-8dd8-551a258bfecc tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f214800fca0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:30.463487 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d3f1a16d-ee67-4a85-8dd8-551a258bfecc tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64" status: 202 len: 0 microversion: 2.1 time: 0.077212 Dec 13 16:52:30.466846 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 279/560] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 13 16:52:30 2021] DELETE /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:52:30.474018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6e42663e-0c8d-4136-9e1d-78a6493d8981 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f214801d670>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:30.489897 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:30.498584 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:30.500675 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:30.502075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fb7d8130-71e4-4850-98ae-6bd99601ac1d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 200 len: 1724 microversion: 2.20 time: 0.245491 Dec 13 16:52:30.514729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 282/561] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:30 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:30.534462 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6e42663e-0c8d-4136-9e1d-78a6493d8981 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64" status: 200 len: 343 microversion: 2.1 time: 0.065656 Dec 13 16:52:30.535035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 280/562] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:52:30 2021] GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64 => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:30.876425 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-315b10be-6605-44f3-93d2-c9e4ae86a0cb req-6aec4a45-39a5-42c2-a7c7-d7b4cc608c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b9554f-cedc-4ce0-a3d7-c4be33ec154f", "name": "network-vif-deleted", "tag": "b5225bcb-5258-419f-8497-ad84cf3faa1c"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:30.878758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:30.878758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:52:30.885919 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-315b10be-6605-44f3-93d2-c9e4ae86a0cb req-6aec4a45-39a5-42c2-a7c7-d7b4cc608c36 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:30.886360 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-315b10be-6605-44f3-93d2-c9e4ae86a0cb req-6aec4a45-39a5-42c2-a7c7-d7b4cc608c36 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:30.900610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-315b10be-6605-44f3-93d2-c9e4ae86a0cb req-6aec4a45-39a5-42c2-a7c7-d7b4cc608c36 service nova] Creating event network-vif-deleted:b5225bcb-5258-419f-8497-ad84cf3faa1c for instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f on hv-cinder-82160 Dec 13 16:52:30.910958 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-315b10be-6605-44f3-93d2-c9e4ae86a0cb req-6aec4a45-39a5-42c2-a7c7-d7b4cc608c36 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038109 Dec 13 16:52:30.912827 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 283/563] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:52:31.523415 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:31.524044 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:31.530751 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:31.531187 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:31.531948 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:31.533006 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:31.547940 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5302acb7-045d-4bca-a029-24e87e3c14ff tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f21482b2940>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:31.548699 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] HTTP exception thrown: Instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f could not be found. Dec 13 16:52:31.549495 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Returning 404 to user: Instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:31.550548 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c37c6bc3-99c8-4884-a560-52934fda7e46 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 404 len: 111 microversion: 2.20 time: 0.031442 Dec 13 16:52:31.551267 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 281/564] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:31 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:52:31.560176 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-34911eee-0a6a-4d31-9191-5a371c29fc07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '.version_select at 0x7f214801da60>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:31.577343 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-5302acb7-045d-4bca-a029-24e87e3c14ff tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] HTTP exception thrown: Volume bd3d2074-9de9-458f-9857-e4c1416f8f64 could not be found. Dec 13 16:52:31.577938 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5302acb7-045d-4bca-a029-24e87e3c14ff tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Returning 404 to user: Volume bd3d2074-9de9-458f-9857-e4c1416f8f64 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:31.578763 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5302acb7-045d-4bca-a029-24e87e3c14ff tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64" status: 404 len: 109 microversion: 2.1 time: 0.035357 Dec 13 16:52:31.579321 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 284/565] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:52:31 2021] GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 13 16:52:31.590601 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-34911eee-0a6a-4d31-9191-5a371c29fc07 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771121436" status: 204 len: 0 microversion: 2.20 time: 0.033934 Dec 13 16:52:31.593786 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-31c0c50a-f272-47e7-9738-ae1bbb8701c6 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f214809a550>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:31.594578 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 282/566] 10.222.0.62 () {60 vars in 1261 bytes} [Mon Dec 13 16:52:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771121436 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 13 16:52:31.638960 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-31c0c50a-f272-47e7-9738-ae1bbb8701c6 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] HTTP exception thrown: Volume bd3d2074-9de9-458f-9857-e4c1416f8f64 could not be found. Dec 13 16:52:31.640170 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-31c0c50a-f272-47e7-9738-ae1bbb8701c6 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Returning 404 to user: Volume bd3d2074-9de9-458f-9857-e4c1416f8f64 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:31.642151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-31c0c50a-f272-47e7-9738-ae1bbb8701c6 tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64" status: 404 len: 109 microversion: 2.1 time: 0.051508 Dec 13 16:52:31.646650 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 285/567] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 13 16:52:31 2021] DELETE /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 13 16:52:31.653020 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8d089388-fd20-4c72-bcfb-de361649caae tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Calling method '.version_select at 0x7f2148149940>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:31.683164 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-8d089388-fd20-4c72-bcfb-de361649caae tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] HTTP exception thrown: Volume bd3d2074-9de9-458f-9857-e4c1416f8f64 could not be found. Dec 13 16:52:31.683980 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8d089388-fd20-4c72-bcfb-de361649caae tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] Returning 404 to user: Volume bd3d2074-9de9-458f-9857-e4c1416f8f64 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:31.684860 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8d089388-fd20-4c72-bcfb-de361649caae tempest-VolumesSnapshotsTestJSON-1617276438 tempest-VolumesSnapshotsTestJSON-1617276438-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64" status: 404 len: 109 microversion: 2.1 time: 0.036906 Dec 13 16:52:31.688263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 283/568] 10.222.0.62 () {58 vars in 1244 bytes} [Mon Dec 13 16:52:31 2021] GET /compute/v2.1/os-volumes/bd3d2074-9de9-458f-9857-e4c1416f8f64 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:52:32.725403 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-066fb574-4a45-41af-92da-0e65714d99a7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'create', calling method: .version_select at 0x7f21481375e0>, body: {"keypair": {"name": "tempest-keypair-1431367091"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:32.743530 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-066fb574-4a45-41af-92da-0e65714d99a7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:52:32.747359 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-066fb574-4a45-41af-92da-0e65714d99a7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for user e9c2500682e64b3a91e811a3ba09bd20 and project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:52:32.902271 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-066fb574-4a45-41af-92da-0e65714d99a7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:52:32.905801 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-066fb574-4a45-41af-92da-0e65714d99a7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for user e9c2500682e64b3a91e811a3ba09bd20 and project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:52:32.919018 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-066fb574-4a45-41af-92da-0e65714d99a7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.198281 Dec 13 16:52:32.919617 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 286/569] 10.222.0.62 () {62 vars in 1198 bytes} [Mon Dec 13 16:52:32 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 13 16:52:34.461134 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2089216646", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14657912-c423-47d5-8443-b0389106e6d6"}], "security_groups": [{"name": "tempest-securitygroup--237178314"}], "key_name": "tempest-keypair-1431367091", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:34.592830 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] validate_networks() for [('14657912-c423-47d5-8443-b0389106e6d6', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:52:35.003491 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:52:35.003925 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:52:35.004398 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:52:35.004835 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:52:35.005243 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:52:35.014412 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:35.014768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:35.015570 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:35.015999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:35.035049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:52:35.039372 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Getting quotas for user e9c2500682e64b3a91e811a3ba09bd20 and project c94e8e265a6f4fb585504a1e95ceda28. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:52:35.051377 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:52:35.053804 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:52:35.106006 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-410944e3-16ca-4785-89ac-b6de82870d7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.651956 Dec 13 16:52:35.106949 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 284/570] 10.222.0.62 () {62 vars in 1187 bytes} [Mon Dec 13 16:52:34 2021] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 13 16:52:35.119141 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f6754e60-35dc-41f4-901c-6dadca540840 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:35.120007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f6754e60-35dc-41f4-901c-6dadca540840 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:35.182567 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f6754e60-35dc-41f4-901c-6dadca540840 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:35.195419 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f6754e60-35dc-41f4-901c-6dadca540840 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:35.195419 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f6754e60-35dc-41f4-901c-6dadca540840 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:35.195937 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f6754e60-35dc-41f4-901c-6dadca540840 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1282 microversion: 2.20 time: 0.082402 Dec 13 16:52:35.196564 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 287/571] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:35 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:52:36.221251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:36.222503 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:36.235359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:36.236510 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:36.239037 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:36.240197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:36.313463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:36.323261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:36.324657 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:36.325792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e65b8f2b-a3d5-411f-b873-93dbc1aa9f84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1352 microversion: 2.20 time: 0.113333 Dec 13 16:52:36.326359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 285/572] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:36 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:37.345278 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:37.346107 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:37.353884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:37.354332 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:37.355144 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:37.355606 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:37.610635 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:37.629848 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:37.632048 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:37.633785 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-95978c74-b358-4964-ac3d-f44cfdc35729 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1407 microversion: 2.20 time: 0.293808 Dec 13 16:52:37.635101 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 288/573] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:37 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:37.774550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-9bf776ac-0294-40dc-86e9-9d7824f53825 req-3031c19a-124d-4f95-baa3-879ce8fdd15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea34650-4715-472f-a562-e8929cb0f319", "tag": "823c9158-6eee-4748-8e22-293145c6db04"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:37.777350 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:37.777350 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:52:37.792142 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-9bf776ac-0294-40dc-86e9-9d7824f53825 req-3031c19a-124d-4f95-baa3-879ce8fdd15b service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:37.792793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-9bf776ac-0294-40dc-86e9-9d7824f53825 req-3031c19a-124d-4f95-baa3-879ce8fdd15b service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:37.805742 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-9bf776ac-0294-40dc-86e9-9d7824f53825 req-3031c19a-124d-4f95-baa3-879ce8fdd15b service nova] Creating event network-changed:823c9158-6eee-4748-8e22-293145c6db04 for instance 3ea34650-4715-472f-a562-e8929cb0f319 on hv-cinder-82160 Dec 13 16:52:37.812337 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-9bf776ac-0294-40dc-86e9-9d7824f53825 req-3031c19a-124d-4f95-baa3-879ce8fdd15b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041483 Dec 13 16:52:37.813254 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 286/574] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:38.652696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:38.653441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:38.660517 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:38.661370 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:38.662781 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:38.663466 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:38.891430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:38.900088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:38.901841 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:38.903271 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b789c676-fdca-47e0-8716-64b5a3bdcf7b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1407 microversion: 2.20 time: 0.254964 Dec 13 16:52:38.903986 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 289/575] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:38 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:39.922169 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:39.922739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:39.929962 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:39.930403 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:39.931183 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:39.931610 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:40.067997 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:40.076396 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:40.077828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:40.078932 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f14d4898-4304-48ee-8ac1-d5af625d0a28 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1407 microversion: 2.20 time: 0.160895 Dec 13 16:52:40.079554 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 287/576] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:39 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:41.098066 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:41.098686 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:41.105602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:41.106042 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:41.106833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:41.107276 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:41.261226 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:41.269345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:41.271114 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:41.272216 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6071971a-97c1-416b-b13a-6e50db8d0ed1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1407 microversion: 2.20 time: 0.178588 Dec 13 16:52:41.272822 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 290/577] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:41 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:42.291050 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:42.292362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:42.304326 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:42.304806 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:42.305632 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:42.306106 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:42.476559 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:42.485812 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:42.487301 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:42.489281 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1af41df5-c8b8-49ad-88c2-41cff4cacbd8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1407 microversion: 2.20 time: 0.201371 Dec 13 16:52:42.489846 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 288/578] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:42 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:43.516309 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:43.516936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:43.524099 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:43.524637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:43.525402 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:43.525833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:43.669253 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:43.677353 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:43.679031 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:43.680251 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9b2a75d1-813d-46c7-912e-c102fb10120f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1407 microversion: 2.20 time: 0.167614 Dec 13 16:52:43.691341 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 291/579] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:43 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:44.045188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-4d4d8759-82ca-4656-be08-cff8326bcb66 req-ff1baa08-4a51-4b0b-8e8a-548b49e78bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea34650-4715-472f-a562-e8929cb0f319", "name": "network-vif-plugged", "status": "completed", "tag": "823c9158-6eee-4748-8e22-293145c6db04"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:44.047086 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:44.047086 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:52:44.055090 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-4d4d8759-82ca-4656-be08-cff8326bcb66 req-ff1baa08-4a51-4b0b-8e8a-548b49e78bd8 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:44.055659 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-4d4d8759-82ca-4656-be08-cff8326bcb66 req-ff1baa08-4a51-4b0b-8e8a-548b49e78bd8 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:44.068105 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-4d4d8759-82ca-4656-be08-cff8326bcb66 req-ff1baa08-4a51-4b0b-8e8a-548b49e78bd8 service nova] Creating event network-vif-plugged:823c9158-6eee-4748-8e22-293145c6db04 for instance 3ea34650-4715-472f-a562-e8929cb0f319 on hv-cinder-82160 Dec 13 16:52:44.073808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-4d4d8759-82ca-4656-be08-cff8326bcb66 req-ff1baa08-4a51-4b0b-8e8a-548b49e78bd8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032321 Dec 13 16:52:44.074479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 289/580] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:44.701671 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:44.702274 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:44.711641 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:44.712187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:44.713026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:44.713509 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:44.876422 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:44.888983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:44.890773 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:44.891955 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f9b17767-e154-48ef-a45e-7c52ed9b8494 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1407 microversion: 2.20 time: 0.196361 Dec 13 16:52:44.892542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 292/581] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:44 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:45.913131 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:45.914025 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:45.921226 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:45.921881 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:45.922826 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:45.923337 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:46.117976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:46.126513 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:46.128001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:46.129237 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-853599e6-b9ee-4d32-aac1-ded933e8a417 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1600 microversion: 2.20 time: 0.221220 Dec 13 16:52:46.129773 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 290/582] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:52:45 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1600 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:52:46.147134 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1003d34b-d028-4930-9984-1ab83e5c2a05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:46.147709 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1003d34b-d028-4930-9984-1ab83e5c2a05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:46.154451 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1003d34b-d028-4930-9984-1ab83e5c2a05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:46.154895 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1003d34b-d028-4930-9984-1ab83e5c2a05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:46.155726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1003d34b-d028-4930-9984-1ab83e5c2a05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:46.156160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1003d34b-d028-4930-9984-1ab83e5c2a05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:46.241879 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1003d34b-d028-4930-9984-1ab83e5c2a05 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098927 Dec 13 16:52:46.242495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 293/583] 10.222.0.62 () {60 vars in 1315 bytes} [Mon Dec 13 16:52:46 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:52:47.305255 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6429b4ba-6f09-4c42-8935-818d86e09d3f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:47.307073 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6429b4ba-6f09-4c42-8935-818d86e09d3f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:47.308658 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-57934b68-39f9-43d9-a218-ef4aafa8ed47 req-1879966a-c42b-427f-b89e-d4fbc39c0003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea34650-4715-472f-a562-e8929cb0f319", "tag": "823c9158-6eee-4748-8e22-293145c6db04"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:47.310261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:47.310261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:52:47.316707 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6429b4ba-6f09-4c42-8935-818d86e09d3f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:47.319372 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-57934b68-39f9-43d9-a218-ef4aafa8ed47 req-1879966a-c42b-427f-b89e-d4fbc39c0003 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:47.320083 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-57934b68-39f9-43d9-a218-ef4aafa8ed47 req-1879966a-c42b-427f-b89e-d4fbc39c0003 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:47.321694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6429b4ba-6f09-4c42-8935-818d86e09d3f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:47.324794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6429b4ba-6f09-4c42-8935-818d86e09d3f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:47.325221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6429b4ba-6f09-4c42-8935-818d86e09d3f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:47.332444 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-57934b68-39f9-43d9-a218-ef4aafa8ed47 req-1879966a-c42b-427f-b89e-d4fbc39c0003 service nova] Creating event network-changed:823c9158-6eee-4748-8e22-293145c6db04 for instance 3ea34650-4715-472f-a562-e8929cb0f319 on hv-cinder-82160 Dec 13 16:52:47.339280 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-57934b68-39f9-43d9-a218-ef4aafa8ed47 req-1879966a-c42b-427f-b89e-d4fbc39c0003 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034186 Dec 13 16:52:47.340180 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 294/584] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:47.413460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6429b4ba-6f09-4c42-8935-818d86e09d3f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.112172 Dec 13 16:52:47.414477 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 291/585] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:47 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:48.427307 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cbab6799-e04c-4315-b968-586b3a31b4ad tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:48.428504 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cbab6799-e04c-4315-b968-586b3a31b4ad tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:48.435395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cbab6799-e04c-4315-b968-586b3a31b4ad tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:48.435982 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cbab6799-e04c-4315-b968-586b3a31b4ad tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:48.436884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cbab6799-e04c-4315-b968-586b3a31b4ad tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:48.437383 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cbab6799-e04c-4315-b968-586b3a31b4ad tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:48.502499 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cbab6799-e04c-4315-b968-586b3a31b4ad tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.079389 Dec 13 16:52:48.503491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 295/586] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:48 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:49.379835 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-352b5f5f-31ad-412a-9185-5657eaa197f2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:49.380871 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-352b5f5f-31ad-412a-9185-5657eaa197f2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:49.388561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-352b5f5f-31ad-412a-9185-5657eaa197f2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:49.389026 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-352b5f5f-31ad-412a-9185-5657eaa197f2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:49.389804 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-352b5f5f-31ad-412a-9185-5657eaa197f2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:49.390231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-352b5f5f-31ad-412a-9185-5657eaa197f2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:49.423079 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-352b5f5f-31ad-412a-9185-5657eaa197f2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047342 Dec 13 16:52:49.423643 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 292/587] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:52:49 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:52:49.500148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f1540445-1cb3-4623-8236-94c3063da8d9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:49.500984 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f1540445-1cb3-4623-8236-94c3063da8d9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:49.514398 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f1540445-1cb3-4623-8236-94c3063da8d9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:49.514946 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f1540445-1cb3-4623-8236-94c3063da8d9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:49.515842 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f1540445-1cb3-4623-8236-94c3063da8d9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:49.516345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f1540445-1cb3-4623-8236-94c3063da8d9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:49.516732 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8a23f994-ff02-4223-babb-9e00b242da06 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:49.517757 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8a23f994-ff02-4223-babb-9e00b242da06 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:49.524796 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a23f994-ff02-4223-babb-9e00b242da06 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:49.525247 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a23f994-ff02-4223-babb-9e00b242da06 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:49.526029 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a23f994-ff02-4223-babb-9e00b242da06 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:49.526454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a23f994-ff02-4223-babb-9e00b242da06 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:49.543821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f1540445-1cb3-4623-8236-94c3063da8d9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:52:49.592681 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8a23f994-ff02-4223-babb-9e00b242da06 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.080755 Dec 13 16:52:49.595792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 293/588] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:49 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:52:49.627838 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f1540445-1cb3-4623-8236-94c3063da8d9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 204 len: 0 microversion: 2.1 time: 0.133567 Dec 13 16:52:49.628454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 296/589] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:52:49 2021] DELETE /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:52:49.637613 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5babeb20-c331-47af-9324-4dd57be7c8a1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:49.638306 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5babeb20-c331-47af-9324-4dd57be7c8a1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:49.645564 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5babeb20-c331-47af-9324-4dd57be7c8a1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:49.645988 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5babeb20-c331-47af-9324-4dd57be7c8a1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:49.646775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5babeb20-c331-47af-9324-4dd57be7c8a1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:49.647203 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5babeb20-c331-47af-9324-4dd57be7c8a1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:49.791375 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-5babeb20-c331-47af-9324-4dd57be7c8a1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:49.802265 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5babeb20-c331-47af-9324-4dd57be7c8a1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1674 microversion: 2.1 time: 0.168748 Dec 13 16:52:49.802819 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 294/590] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:49 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:50.606046 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ece37fc4-317a-45f2-bbe1-e989f85e5883 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:50.607259 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ece37fc4-317a-45f2-bbe1-e989f85e5883 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:50.615913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ece37fc4-317a-45f2-bbe1-e989f85e5883 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:50.616364 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ece37fc4-317a-45f2-bbe1-e989f85e5883 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:50.617336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ece37fc4-317a-45f2-bbe1-e989f85e5883 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:50.617829 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ece37fc4-317a-45f2-bbe1-e989f85e5883 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:50.682186 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ece37fc4-317a-45f2-bbe1-e989f85e5883 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.081303 Dec 13 16:52:50.682892 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 297/591] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:50 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:50.822636 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6bb2f223-06d1-4f1c-a3d5-5c47db3a533d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:50.823210 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6bb2f223-06d1-4f1c-a3d5-5c47db3a533d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:50.830370 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6bb2f223-06d1-4f1c-a3d5-5c47db3a533d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:50.830812 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6bb2f223-06d1-4f1c-a3d5-5c47db3a533d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:50.831592 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6bb2f223-06d1-4f1c-a3d5-5c47db3a533d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:50.832026 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6bb2f223-06d1-4f1c-a3d5-5c47db3a533d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:50.978861 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6bb2f223-06d1-4f1c-a3d5-5c47db3a533d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:50.986947 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6bb2f223-06d1-4f1c-a3d5-5c47db3a533d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1674 microversion: 2.1 time: 0.168707 Dec 13 16:52:50.987512 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 295/592] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:50 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:51.695328 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9e4a82e1-7880-4c27-a23f-692c792a17a3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:51.696390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9e4a82e1-7880-4c27-a23f-692c792a17a3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:51.705205 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9e4a82e1-7880-4c27-a23f-692c792a17a3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:51.705650 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9e4a82e1-7880-4c27-a23f-692c792a17a3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:51.706440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9e4a82e1-7880-4c27-a23f-692c792a17a3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:51.706869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9e4a82e1-7880-4c27-a23f-692c792a17a3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:51.784047 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9e4a82e1-7880-4c27-a23f-692c792a17a3 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.093192 Dec 13 16:52:51.787260 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 298/593] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:51 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:52.005020 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-fb383f5b-638c-4807-a3d6-1262100a8fc8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:52.005635 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-fb383f5b-638c-4807-a3d6-1262100a8fc8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:52.012802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fb383f5b-638c-4807-a3d6-1262100a8fc8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:52.013519 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fb383f5b-638c-4807-a3d6-1262100a8fc8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:52.014148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fb383f5b-638c-4807-a3d6-1262100a8fc8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:52.014571 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fb383f5b-638c-4807-a3d6-1262100a8fc8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:52.158759 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fb383f5b-638c-4807-a3d6-1262100a8fc8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:52.167882 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-fb383f5b-638c-4807-a3d6-1262100a8fc8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1674 microversion: 2.1 time: 0.166821 Dec 13 16:52:52.177797 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 296/594] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:51 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:52.678301 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-5f60567b-4660-4c65-89b8-11ba0cd78cc7 req-82bac827-2592-4d59-a617-4e34f224efa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2466eb-448e-4984-bf58-746c53cddaac", "name": "network-vif-deleted", "tag": "2256f239-7e22-47c2-8af7-d787985f0627"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:52.680083 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:52:52.680083 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:52:52.689688 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-5f60567b-4660-4c65-89b8-11ba0cd78cc7 req-82bac827-2592-4d59-a617-4e34f224efa7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:52.690411 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-5f60567b-4660-4c65-89b8-11ba0cd78cc7 req-82bac827-2592-4d59-a617-4e34f224efa7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:52.703620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-5f60567b-4660-4c65-89b8-11ba0cd78cc7 req-82bac827-2592-4d59-a617-4e34f224efa7 service nova] Creating event network-vif-deleted:2256f239-7e22-47c2-8af7-d787985f0627 for instance 1f2466eb-448e-4984-bf58-746c53cddaac on hv-cinder-82160 Dec 13 16:52:52.710943 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-5f60567b-4660-4c65-89b8-11ba0cd78cc7 req-82bac827-2592-4d59-a617-4e34f224efa7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036504 Dec 13 16:52:52.711726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 299/595] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:52:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:52:52.795834 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-88f7447b-d730-4a38-aaf2-799970914b1f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:52.797072 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-88f7447b-d730-4a38-aaf2-799970914b1f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:52.804119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-88f7447b-d730-4a38-aaf2-799970914b1f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:52.804730 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-88f7447b-d730-4a38-aaf2-799970914b1f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:52.805776 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-88f7447b-d730-4a38-aaf2-799970914b1f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:52.806586 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-88f7447b-d730-4a38-aaf2-799970914b1f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:52.896140 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-88f7447b-d730-4a38-aaf2-799970914b1f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.103501 Dec 13 16:52:52.897292 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 297/596] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:52 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:52:53.186012 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:53.186963 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:53.193783 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:53.194422 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:53.195513 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:53.196096 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:53.231581 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:53.232291 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:53.232923 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lazy-loading 'fault' on Instance uuid 1f2466eb-448e-4984-bf58-746c53cddaac {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:52:53.305018 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:53.312861 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2cfe8f46-ee3a-4fa1-9579-18adc8683665 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 200 len: 1328 microversion: 2.1 time: 0.131295 Dec 13 16:52:53.313813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 300/597] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:53 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 1328 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:53.908719 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2d3c01e8-e5e8-46b7-a2ed-e0f53497388c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:53.910392 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-2d3c01e8-e5e8-46b7-a2ed-e0f53497388c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:53.917878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2d3c01e8-e5e8-46b7-a2ed-e0f53497388c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:53.918536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2d3c01e8-e5e8-46b7-a2ed-e0f53497388c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:53.919512 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2d3c01e8-e5e8-46b7-a2ed-e0f53497388c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:53.920108 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2d3c01e8-e5e8-46b7-a2ed-e0f53497388c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:53.983656 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2d3c01e8-e5e8-46b7-a2ed-e0f53497388c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.079075 Dec 13 16:52:53.984300 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 298/598] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:53 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:54.334262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:54.335392 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:54.345618 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:54.346346 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:54.347637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:54.348350 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:54.380461 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] HTTP exception thrown: Instance 1f2466eb-448e-4984-bf58-746c53cddaac could not be found. Dec 13 16:52:54.381491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Returning 404 to user: Instance 1f2466eb-448e-4984-bf58-746c53cddaac could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:52:54.382884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-41565ad1-c469-4e03-bd97-83bbcfba4ad4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 404 len: 111 microversion: 2.1 time: 0.054837 Dec 13 16:52:54.383815 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 301/599] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:54 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:52:54.397818 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b53ac3f7-9704-40a4-a16d-16c18b38211d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '.version_select at 0x7f214801d1f0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:54.424387 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b53ac3f7-9704-40a4-a16d-16c18b38211d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898491315" status: 202 len: 0 microversion: 2.1 time: 0.032789 Dec 13 16:52:54.425273 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 299/600] 10.222.0.62 () {58 vars in 1220 bytes} [Mon Dec 13 16:52:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898491315 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:52:54.995418 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-bdd397ee-4aec-4603-90d5-d26b56e94e8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:54.996727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-bdd397ee-4aec-4603-90d5-d26b56e94e8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:55.003590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bdd397ee-4aec-4603-90d5-d26b56e94e8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:55.004026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bdd397ee-4aec-4603-90d5-d26b56e94e8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:55.004868 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bdd397ee-4aec-4603-90d5-d26b56e94e8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:55.005301 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bdd397ee-4aec-4603-90d5-d26b56e94e8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:55.066412 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-bdd397ee-4aec-4603-90d5-d26b56e94e8b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.074595 Dec 13 16:52:55.067063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 302/601] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:54 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:55.201705 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2c5accf1-d189-4f62-a61e-64d1ac2685a9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'create', calling method: .version_select at 0x7f213bfc8040>, body: {"keypair": {"name": "tempest-keypair-2131611037"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:55.218979 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-2c5accf1-d189-4f62-a61e-64d1ac2685a9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for project febd1024088a4a22984d59922da28de1. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:52:55.224518 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-2c5accf1-d189-4f62-a61e-64d1ac2685a9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for user c282fd140f5645ca89c2e64888ea1345 and project febd1024088a4a22984d59922da28de1. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:52:55.378810 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-2c5accf1-d189-4f62-a61e-64d1ac2685a9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for project febd1024088a4a22984d59922da28de1. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:52:55.382860 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-2c5accf1-d189-4f62-a61e-64d1ac2685a9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for user c282fd140f5645ca89c2e64888ea1345 and project febd1024088a4a22984d59922da28de1. Resources: {'key_pairs'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:52:55.396865 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2c5accf1-d189-4f62-a61e-64d1ac2685a9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.200557 Dec 13 16:52:55.397443 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 300/602] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 13 16:52:55 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:56.079591 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0b7f61b2-698f-4256-b3ef-9b5dd19b4e84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:56.080813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0b7f61b2-698f-4256-b3ef-9b5dd19b4e84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:56.089337 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0b7f61b2-698f-4256-b3ef-9b5dd19b4e84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:56.089903 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0b7f61b2-698f-4256-b3ef-9b5dd19b4e84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:56.090802 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0b7f61b2-698f-4256-b3ef-9b5dd19b4e84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:56.091266 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0b7f61b2-698f-4256-b3ef-9b5dd19b4e84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:56.154308 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0b7f61b2-698f-4256-b3ef-9b5dd19b4e84 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.079347 Dec 13 16:52:56.155225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 303/603] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:56 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:57.105622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1365364240", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faba440c-3470-4b72-a53c-aa5da04ea307"}], "security_groups": [{"name": "tempest-securitygroup--394070996"}], "key_name": "tempest-keypair-2131611037", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:57.166184 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-724738c8-cbd0-467c-bedf-ed0dac953e4b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:57.167243 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-724738c8-cbd0-467c-bedf-ed0dac953e4b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:57.174478 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-724738c8-cbd0-467c-bedf-ed0dac953e4b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:57.174913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-724738c8-cbd0-467c-bedf-ed0dac953e4b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:57.175681 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-724738c8-cbd0-467c-bedf-ed0dac953e4b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:57.176099 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-724738c8-cbd0-467c-bedf-ed0dac953e4b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:57.213540 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] validate_networks() for [('faba440c-3470-4b72-a53c-aa5da04ea307', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:52:57.240440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-724738c8-cbd0-467c-bedf-ed0dac953e4b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.078196 Dec 13 16:52:57.241067 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 304/604] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:57 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:57.595868 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:52:57.596280 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:52:57.596790 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:52:57.597193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:52:57.597597 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:52:57.607395 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:57.607829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:57.608656 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:57.609119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:57.626976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for project febd1024088a4a22984d59922da28de1. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:52:57.630728 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Getting quotas for user c282fd140f5645ca89c2e64888ea1345 and project febd1024088a4a22984d59922da28de1. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:52:57.641268 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:52:57.643676 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:52:57.690071 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ad980eba-b8a1-4ce3-852c-943fcb5fb83a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.589351 Dec 13 16:52:57.690711 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 301/605] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:52:57 2021] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:52:57.701783 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d0c8b581-3218-4573-b42b-94bceaf714c4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:57.702644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d0c8b581-3218-4573-b42b-94bceaf714c4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:57.759330 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d0c8b581-3218-4573-b42b-94bceaf714c4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:57.766940 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d0c8b581-3218-4573-b42b-94bceaf714c4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1238 microversion: 2.1 time: 0.069719 Dec 13 16:52:57.767507 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 305/606] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:57 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:58.252113 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-aaa829f3-212e-41ac-85d4-953aaf6014f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:58.253399 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-aaa829f3-212e-41ac-85d4-953aaf6014f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:58.263300 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-aaa829f3-212e-41ac-85d4-953aaf6014f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:58.263749 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-aaa829f3-212e-41ac-85d4-953aaf6014f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:58.264519 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-aaa829f3-212e-41ac-85d4-953aaf6014f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:58.265049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-aaa829f3-212e-41ac-85d4-953aaf6014f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:58.330709 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-aaa829f3-212e-41ac-85d4-953aaf6014f0 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.082256 Dec 13 16:52:58.334583 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 302/607] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:58 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:58.783836 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ab596484-0d29-48c2-9c83-5abba7b1bd04 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:58.785308 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ab596484-0d29-48c2-9c83-5abba7b1bd04 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:58.792627 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ab596484-0d29-48c2-9c83-5abba7b1bd04 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:58.793020 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ab596484-0d29-48c2-9c83-5abba7b1bd04 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:58.793810 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ab596484-0d29-48c2-9c83-5abba7b1bd04 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:58.794233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ab596484-0d29-48c2-9c83-5abba7b1bd04 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:58.868163 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ab596484-0d29-48c2-9c83-5abba7b1bd04 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:52:58.875986 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ab596484-0d29-48c2-9c83-5abba7b1bd04 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1308 microversion: 2.1 time: 0.096007 Dec 13 16:52:58.876804 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 306/608] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:58 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:59.343557 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c765d9ef-9f91-4e5d-a05e-b156082ee381 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:52:59.345204 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c765d9ef-9f91-4e5d-a05e-b156082ee381 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:59.352657 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c765d9ef-9f91-4e5d-a05e-b156082ee381 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:59.353099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c765d9ef-9f91-4e5d-a05e-b156082ee381 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:59.353997 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c765d9ef-9f91-4e5d-a05e-b156082ee381 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:59.354431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c765d9ef-9f91-4e5d-a05e-b156082ee381 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:59.414248 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c765d9ef-9f91-4e5d-a05e-b156082ee381 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.075252 Dec 13 16:52:59.415017 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 303/609] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:52:59 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:52:59.894382 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e00ed0eb-2312-436b-b227-094a60eec861 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:52:59.894963 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e00ed0eb-2312-436b-b227-094a60eec861 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:52:59.901769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e00ed0eb-2312-436b-b227-094a60eec861 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:59.902214 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e00ed0eb-2312-436b-b227-094a60eec861 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:52:59.903024 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e00ed0eb-2312-436b-b227-094a60eec861 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:52:59.903422 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e00ed0eb-2312-436b-b227-094a60eec861 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:00.130482 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e00ed0eb-2312-436b-b227-094a60eec861 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:00.138784 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e00ed0eb-2312-436b-b227-094a60eec861 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.248044 Dec 13 16:53:00.139630 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 307/610] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:52:59 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:00.426570 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c57989e9-2e25-46f4-a1a9-3a2a2e13c2d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:00.428224 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c57989e9-2e25-46f4-a1a9-3a2a2e13c2d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:00.435972 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c57989e9-2e25-46f4-a1a9-3a2a2e13c2d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:00.436476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c57989e9-2e25-46f4-a1a9-3a2a2e13c2d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:00.437377 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c57989e9-2e25-46f4-a1a9-3a2a2e13c2d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:00.437805 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c57989e9-2e25-46f4-a1a9-3a2a2e13c2d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:00.478797 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-1ec7447f-40fc-4fa1-97eb-6062ec312c8c req-011fdb44-b8cf-4d84-9892-be56e5181095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69060b24-b5af-457d-9dc6-6999ce84c7bc", "tag": "45133903-44dc-4175-8074-bd78bf1235a8"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:00.489265 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:53:00.489265 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:53:00.500313 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c57989e9-2e25-46f4-a1a9-3a2a2e13c2d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 14 microversion: 2.20 time: 0.078071 Dec 13 16:53:00.503849 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 304/611] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:00 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:53:00.507390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-1ec7447f-40fc-4fa1-97eb-6062ec312c8c req-011fdb44-b8cf-4d84-9892-be56e5181095 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:00.507858 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-1ec7447f-40fc-4fa1-97eb-6062ec312c8c req-011fdb44-b8cf-4d84-9892-be56e5181095 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:00.520976 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-1ec7447f-40fc-4fa1-97eb-6062ec312c8c req-011fdb44-b8cf-4d84-9892-be56e5181095 service nova] Creating event network-changed:45133903-44dc-4175-8074-bd78bf1235a8 for instance 69060b24-b5af-457d-9dc6-6999ce84c7bc on hv-cinder-82160 Dec 13 16:53:00.526786 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-1ec7447f-40fc-4fa1-97eb-6062ec312c8c req-011fdb44-b8cf-4d84-9892-be56e5181095 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051272 Dec 13 16:53:00.527420 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 308/612] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:53:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:53:01.158221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b8fa3254-9485-4ec9-8ca0-ef5e4a48f501 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:01.158819 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b8fa3254-9485-4ec9-8ca0-ef5e4a48f501 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:01.165961 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b8fa3254-9485-4ec9-8ca0-ef5e4a48f501 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:01.166622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b8fa3254-9485-4ec9-8ca0-ef5e4a48f501 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:01.167187 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b8fa3254-9485-4ec9-8ca0-ef5e4a48f501 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:01.167605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b8fa3254-9485-4ec9-8ca0-ef5e4a48f501 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:01.309370 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b8fa3254-9485-4ec9-8ca0-ef5e4a48f501 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:01.316775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b8fa3254-9485-4ec9-8ca0-ef5e4a48f501 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.162719 Dec 13 16:53:01.317550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 305/613] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:01 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:01.512136 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-99dbd456-daf3-436b-8a5e-231ca0fea639 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:01.513183 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-99dbd456-daf3-436b-8a5e-231ca0fea639 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:01.521700 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-99dbd456-daf3-436b-8a5e-231ca0fea639 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:01.522369 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-99dbd456-daf3-436b-8a5e-231ca0fea639 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:01.523522 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-99dbd456-daf3-436b-8a5e-231ca0fea639 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:01.524078 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-99dbd456-daf3-436b-8a5e-231ca0fea639 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:02.334016 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b8d448ec-27fc-4fe0-b174-b346cbbbe8e4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:02.334626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b8d448ec-27fc-4fe0-b174-b346cbbbe8e4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:02.342096 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b8d448ec-27fc-4fe0-b174-b346cbbbe8e4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:02.342538 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b8d448ec-27fc-4fe0-b174-b346cbbbe8e4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:02.343327 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b8d448ec-27fc-4fe0-b174-b346cbbbe8e4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:02.343751 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b8d448ec-27fc-4fe0-b174-b346cbbbe8e4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:02.485699 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b8d448ec-27fc-4fe0-b174-b346cbbbe8e4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:02.494831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b8d448ec-27fc-4fe0-b174-b346cbbbe8e4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.164487 Dec 13 16:53:02.495405 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 306/614] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:02 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:53:03.512774 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-82a29ddc-960e-4f67-8460-2eb18f9b734f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:03.513468 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-82a29ddc-960e-4f67-8460-2eb18f9b734f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:03.521428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-82a29ddc-960e-4f67-8460-2eb18f9b734f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:03.522028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-82a29ddc-960e-4f67-8460-2eb18f9b734f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:03.523130 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-82a29ddc-960e-4f67-8460-2eb18f9b734f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:03.523790 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-82a29ddc-960e-4f67-8460-2eb18f9b734f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:03.670137 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-82a29ddc-960e-4f67-8460-2eb18f9b734f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:03.679220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-82a29ddc-960e-4f67-8460-2eb18f9b734f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.170629 Dec 13 16:53:03.679856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 307/615] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:03 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:04.045619 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-99dbd456-daf3-436b-8a5e-231ca0fea639 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 18508 microversion: 2.20 time: 2.538086 Dec 13 16:53:04.046246 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 309/616] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:01 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 18508 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:04.703194 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3f7fb8bc-348e-4f56-90a7-f459fa328ae7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:04.703776 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3f7fb8bc-348e-4f56-90a7-f459fa328ae7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:04.713563 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3f7fb8bc-348e-4f56-90a7-f459fa328ae7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:04.714009 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3f7fb8bc-348e-4f56-90a7-f459fa328ae7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:04.715168 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3f7fb8bc-348e-4f56-90a7-f459fa328ae7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:04.715775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3f7fb8bc-348e-4f56-90a7-f459fa328ae7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:04.873654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3f7fb8bc-348e-4f56-90a7-f459fa328ae7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:04.881801 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3f7fb8bc-348e-4f56-90a7-f459fa328ae7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.184051 Dec 13 16:53:04.882353 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 308/617] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:04 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:05.060305 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-048ca4cb-3f89-4a1a-ab2a-cb6b282ebd25 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:05.061611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-048ca4cb-3f89-4a1a-ab2a-cb6b282ebd25 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:05.071571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-048ca4cb-3f89-4a1a-ab2a-cb6b282ebd25 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:05.072192 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-048ca4cb-3f89-4a1a-ab2a-cb6b282ebd25 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:05.073333 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-048ca4cb-3f89-4a1a-ab2a-cb6b282ebd25 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:05.073954 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-048ca4cb-3f89-4a1a-ab2a-cb6b282ebd25 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:05.152838 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-048ca4cb-3f89-4a1a-ab2a-cb6b282ebd25 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 19342 microversion: 2.20 time: 0.098524 Dec 13 16:53:05.153482 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 310/618] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:05 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 19342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:05.899547 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-231194dc-5236-4169-9f85-c697cac17d1a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:05.900139 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-231194dc-5236-4169-9f85-c697cac17d1a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:05.907361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-231194dc-5236-4169-9f85-c697cac17d1a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:05.907810 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-231194dc-5236-4169-9f85-c697cac17d1a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:05.908728 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-231194dc-5236-4169-9f85-c697cac17d1a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:05.909140 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-231194dc-5236-4169-9f85-c697cac17d1a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:06.043714 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-231194dc-5236-4169-9f85-c697cac17d1a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:06.051915 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-231194dc-5236-4169-9f85-c697cac17d1a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.156087 Dec 13 16:53:06.052492 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 309/619] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:05 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:06.165885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e8c0ba22-b20c-4bb8-aad7-a6de7c385fba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:06.166774 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e8c0ba22-b20c-4bb8-aad7-a6de7c385fba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:06.177453 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e8c0ba22-b20c-4bb8-aad7-a6de7c385fba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:06.178046 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e8c0ba22-b20c-4bb8-aad7-a6de7c385fba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:06.179032 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e8c0ba22-b20c-4bb8-aad7-a6de7c385fba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:06.179552 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e8c0ba22-b20c-4bb8-aad7-a6de7c385fba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:06.259437 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e8c0ba22-b20c-4bb8-aad7-a6de7c385fba tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 22119 microversion: 2.20 time: 0.097709 Dec 13 16:53:06.260384 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 311/620] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:06 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 22119 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:07.069610 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d4cff789-9883-4a92-9e53-8cb1042571b5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:07.070265 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d4cff789-9883-4a92-9e53-8cb1042571b5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:07.077047 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d4cff789-9883-4a92-9e53-8cb1042571b5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:07.077497 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d4cff789-9883-4a92-9e53-8cb1042571b5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:07.078272 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d4cff789-9883-4a92-9e53-8cb1042571b5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:07.078706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d4cff789-9883-4a92-9e53-8cb1042571b5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:07.219253 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d4cff789-9883-4a92-9e53-8cb1042571b5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:07.227373 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d4cff789-9883-4a92-9e53-8cb1042571b5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.161661 Dec 13 16:53:07.227938 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 310/621] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:07 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:07.272558 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-14fb06c0-2c30-41e9-b07e-88b6ec3c6c13 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:07.273571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-14fb06c0-2c30-41e9-b07e-88b6ec3c6c13 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:07.280983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-14fb06c0-2c30-41e9-b07e-88b6ec3c6c13 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:07.281420 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-14fb06c0-2c30-41e9-b07e-88b6ec3c6c13 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:07.282183 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-14fb06c0-2c30-41e9-b07e-88b6ec3c6c13 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:07.282611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-14fb06c0-2c30-41e9-b07e-88b6ec3c6c13 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:07.358345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-14fb06c0-2c30-41e9-b07e-88b6ec3c6c13 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 23235 microversion: 2.20 time: 0.089680 Dec 13 16:53:07.359002 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 312/622] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:07 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 23235 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:08.159192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-529d6e25-9df4-4611-9419-6786c5cf8439 req-83acb269-15e1-4d8a-afb4-fd9b8d72bc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69060b24-b5af-457d-9dc6-6999ce84c7bc", "name": "network-vif-plugged", "status": "completed", "tag": "45133903-44dc-4175-8074-bd78bf1235a8"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:08.161109 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:53:08.161109 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:53:08.170645 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-529d6e25-9df4-4611-9419-6786c5cf8439 req-83acb269-15e1-4d8a-afb4-fd9b8d72bc3a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:08.171869 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-529d6e25-9df4-4611-9419-6786c5cf8439 req-83acb269-15e1-4d8a-afb4-fd9b8d72bc3a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:08.187601 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-529d6e25-9df4-4611-9419-6786c5cf8439 req-83acb269-15e1-4d8a-afb4-fd9b8d72bc3a service nova] Creating event network-vif-plugged:45133903-44dc-4175-8074-bd78bf1235a8 for instance 69060b24-b5af-457d-9dc6-6999ce84c7bc on hv-cinder-82160 Dec 13 16:53:08.193265 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-529d6e25-9df4-4611-9419-6786c5cf8439 req-83acb269-15e1-4d8a-afb4-fd9b8d72bc3a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037821 Dec 13 16:53:08.193878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 311/623] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:53:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:53:08.247140 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a7f2c1af-9a5f-41c3-a502-44f3ce7f115e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:08.248194 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a7f2c1af-9a5f-41c3-a502-44f3ce7f115e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:08.256291 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a7f2c1af-9a5f-41c3-a502-44f3ce7f115e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:08.256769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a7f2c1af-9a5f-41c3-a502-44f3ce7f115e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:08.257724 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a7f2c1af-9a5f-41c3-a502-44f3ce7f115e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:08.258136 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a7f2c1af-9a5f-41c3-a502-44f3ce7f115e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:08.371017 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-271c2b8b-022c-4fdb-a87e-db55c3687f48 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:08.372043 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-271c2b8b-022c-4fdb-a87e-db55c3687f48 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:08.378847 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-271c2b8b-022c-4fdb-a87e-db55c3687f48 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:08.379212 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-271c2b8b-022c-4fdb-a87e-db55c3687f48 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:08.379995 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-271c2b8b-022c-4fdb-a87e-db55c3687f48 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:08.380492 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-271c2b8b-022c-4fdb-a87e-db55c3687f48 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:08.414391 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a7f2c1af-9a5f-41c3-a502-44f3ce7f115e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:08.421954 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a7f2c1af-9a5f-41c3-a502-44f3ce7f115e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.178990 Dec 13 16:53:08.422521 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 313/624] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:08 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:09.439486 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9502b55c-1b6b-4ecc-af75-a8834e71bde6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:09.440335 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9502b55c-1b6b-4ecc-af75-a8834e71bde6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:09.447311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9502b55c-1b6b-4ecc-af75-a8834e71bde6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:09.447756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9502b55c-1b6b-4ecc-af75-a8834e71bde6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:09.448533 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9502b55c-1b6b-4ecc-af75-a8834e71bde6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:09.449286 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9502b55c-1b6b-4ecc-af75-a8834e71bde6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:09.596252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9502b55c-1b6b-4ecc-af75-a8834e71bde6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:09.607037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9502b55c-1b6b-4ecc-af75-a8834e71bde6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.171383 Dec 13 16:53:09.607634 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 314/625] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:09 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:10.627321 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e9df71ef-9942-45fa-ba86-9f677464e713 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:10.628627 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e9df71ef-9942-45fa-ba86-9f677464e713 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:10.639606 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e9df71ef-9942-45fa-ba86-9f677464e713 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:10.640069 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e9df71ef-9942-45fa-ba86-9f677464e713 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:10.640889 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e9df71ef-9942-45fa-ba86-9f677464e713 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:10.641429 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e9df71ef-9942-45fa-ba86-9f677464e713 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:10.972487 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e9df71ef-9942-45fa-ba86-9f677464e713 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:10.984869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e9df71ef-9942-45fa-ba86-9f677464e713 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.362018 Dec 13 16:53:10.985645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 315/626] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:10 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:53:11.030914 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-271c2b8b-022c-4fdb-a87e-db55c3687f48 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 27525 microversion: 2.20 time: 2.663698 Dec 13 16:53:11.032024 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 312/627] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:08 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 27525 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:12.006198 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-850fd1a9-6181-4a10-bb4d-7f94686986e9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:12.007636 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-850fd1a9-6181-4a10-bb4d-7f94686986e9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:12.017655 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-850fd1a9-6181-4a10-bb4d-7f94686986e9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:12.018146 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-850fd1a9-6181-4a10-bb4d-7f94686986e9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:12.018863 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-850fd1a9-6181-4a10-bb4d-7f94686986e9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:12.019300 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-850fd1a9-6181-4a10-bb4d-7f94686986e9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:12.043862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-644c8e70-ffe5-43ff-bf09-00b9721a2a3c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:12.044881 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-644c8e70-ffe5-43ff-bf09-00b9721a2a3c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:12.052278 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-644c8e70-ffe5-43ff-bf09-00b9721a2a3c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:12.052751 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-644c8e70-ffe5-43ff-bf09-00b9721a2a3c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:12.053548 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-644c8e70-ffe5-43ff-bf09-00b9721a2a3c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:12.053976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-644c8e70-ffe5-43ff-bf09-00b9721a2a3c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:12.146463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-644c8e70-ffe5-43ff-bf09-00b9721a2a3c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 27875 microversion: 2.20 time: 0.105994 Dec 13 16:53:12.147403 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 313/628] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:12 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 27875 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:12.179609 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-850fd1a9-6181-4a10-bb4d-7f94686986e9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:12.187560 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-850fd1a9-6181-4a10-bb4d-7f94686986e9 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1363 microversion: 2.1 time: 0.187447 Dec 13 16:53:12.188131 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 316/629] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:11 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:13.160292 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f06daa03-864f-4fd3-95b4-fa36d49310d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:13.161317 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f06daa03-864f-4fd3-95b4-fa36d49310d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:13.168742 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f06daa03-864f-4fd3-95b4-fa36d49310d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:13.169192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f06daa03-864f-4fd3-95b4-fa36d49310d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:13.169973 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f06daa03-864f-4fd3-95b4-fa36d49310d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:13.170401 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f06daa03-864f-4fd3-95b4-fa36d49310d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:13.207365 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f9583136-a1a1-443a-b7f0-926993b410a3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:13.207965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f9583136-a1a1-443a-b7f0-926993b410a3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:13.215928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9583136-a1a1-443a-b7f0-926993b410a3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:13.216330 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9583136-a1a1-443a-b7f0-926993b410a3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:13.217191 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9583136-a1a1-443a-b7f0-926993b410a3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:13.217620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f9583136-a1a1-443a-b7f0-926993b410a3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:13.244616 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f06daa03-864f-4fd3-95b4-fa36d49310d9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 28171 microversion: 2.20 time: 0.089173 Dec 13 16:53:13.245303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 314/630] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:13 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 28171 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:13.371133 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f9583136-a1a1-443a-b7f0-926993b410a3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:13.379092 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f9583136-a1a1-443a-b7f0-926993b410a3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1548 microversion: 2.1 time: 0.176859 Dec 13 16:53:13.379661 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 317/631] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:13 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:13.398355 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a19127a0-ec7d-4269-aa6b-4ae590f06452 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:13.399244 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a19127a0-ec7d-4269-aa6b-4ae590f06452 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:13.407623 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a19127a0-ec7d-4269-aa6b-4ae590f06452 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:13.408191 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a19127a0-ec7d-4269-aa6b-4ae590f06452 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:13.409196 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a19127a0-ec7d-4269-aa6b-4ae590f06452 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:13.409739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a19127a0-ec7d-4269-aa6b-4ae590f06452 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:13.568466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a19127a0-ec7d-4269-aa6b-4ae590f06452 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175638 Dec 13 16:53:13.569143 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 315/632] 10.222.0.62 () {58 vars in 1274 bytes} [Mon Dec 13 16:53:13 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:53:14.258521 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-21324947-d7da-4bf6-8fbd-b1687c114c4c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:14.259430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-21324947-d7da-4bf6-8fbd-b1687c114c4c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:14.266128 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-21324947-d7da-4bf6-8fbd-b1687c114c4c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:14.266573 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-21324947-d7da-4bf6-8fbd-b1687c114c4c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:14.267346 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-21324947-d7da-4bf6-8fbd-b1687c114c4c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:14.267769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-21324947-d7da-4bf6-8fbd-b1687c114c4c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:14.352379 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-21324947-d7da-4bf6-8fbd-b1687c114c4c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 28364 microversion: 2.20 time: 0.097792 Dec 13 16:53:14.353098 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 318/633] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:14 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 28364 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:14.624040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f27feb9d-03b5-4845-a4d3-4e535add0c33 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:14.631521 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-0bfb7ea5-4b2f-4ccf-a73c-9fded4c94e1f req-ec156866-cee0-4005-917d-b48d0412abe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69060b24-b5af-457d-9dc6-6999ce84c7bc", "tag": "45133903-44dc-4175-8074-bd78bf1235a8"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:14.633434 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f27feb9d-03b5-4845-a4d3-4e535add0c33 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:14.634882 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:53:14.634882 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:53:14.649549 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f27feb9d-03b5-4845-a4d3-4e535add0c33 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:14.649995 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f27feb9d-03b5-4845-a4d3-4e535add0c33 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:14.650794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f27feb9d-03b5-4845-a4d3-4e535add0c33 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:14.651217 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f27feb9d-03b5-4845-a4d3-4e535add0c33 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:14.657554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-0bfb7ea5-4b2f-4ccf-a73c-9fded4c94e1f req-ec156866-cee0-4005-917d-b48d0412abe4 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:14.657990 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-0bfb7ea5-4b2f-4ccf-a73c-9fded4c94e1f req-ec156866-cee0-4005-917d-b48d0412abe4 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:14.672714 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-0bfb7ea5-4b2f-4ccf-a73c-9fded4c94e1f req-ec156866-cee0-4005-917d-b48d0412abe4 service nova] Creating event network-changed:45133903-44dc-4175-8074-bd78bf1235a8 for instance 69060b24-b5af-457d-9dc6-6999ce84c7bc on hv-cinder-82160 Dec 13 16:53:14.678187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-0bfb7ea5-4b2f-4ccf-a73c-9fded4c94e1f req-ec156866-cee0-4005-917d-b48d0412abe4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051412 Dec 13 16:53:14.682997 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 319/634] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:53:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:53:14.723474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f27feb9d-03b5-4845-a4d3-4e535add0c33 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.104188 Dec 13 16:53:14.724679 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 316/635] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:14 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:53:15.366053 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-65e08a57-613a-4fe0-bb68-e7525efefe8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:15.367249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-65e08a57-613a-4fe0-bb68-e7525efefe8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:15.374222 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-65e08a57-613a-4fe0-bb68-e7525efefe8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:15.374698 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-65e08a57-613a-4fe0-bb68-e7525efefe8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:15.375458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-65e08a57-613a-4fe0-bb68-e7525efefe8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:15.375879 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-65e08a57-613a-4fe0-bb68-e7525efefe8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:15.450569 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-65e08a57-613a-4fe0-bb68-e7525efefe8d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 28497 microversion: 2.20 time: 0.089122 Dec 13 16:53:15.451267 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 320/636] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:15 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 28497 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:15.736723 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6d455cc0-3502-47d7-99cc-a3375e44e83f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:15.738004 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6d455cc0-3502-47d7-99cc-a3375e44e83f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:15.748346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6d455cc0-3502-47d7-99cc-a3375e44e83f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:15.748887 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6d455cc0-3502-47d7-99cc-a3375e44e83f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:15.749806 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6d455cc0-3502-47d7-99cc-a3375e44e83f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:15.750326 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6d455cc0-3502-47d7-99cc-a3375e44e83f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:15.811942 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6d455cc0-3502-47d7-99cc-a3375e44e83f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.079908 Dec 13 16:53:15.812610 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 317/637] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:15 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 16:53:16.464441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d9ed8a42-38c0-4288-9cfe-cc25490a24dd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:16.465662 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d9ed8a42-38c0-4288-9cfe-cc25490a24dd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:16.474083 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d9ed8a42-38c0-4288-9cfe-cc25490a24dd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:16.474607 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d9ed8a42-38c0-4288-9cfe-cc25490a24dd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:16.475555 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d9ed8a42-38c0-4288-9cfe-cc25490a24dd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:16.476373 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d9ed8a42-38c0-4288-9cfe-cc25490a24dd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:16.560298 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d9ed8a42-38c0-4288-9cfe-cc25490a24dd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 28630 microversion: 2.20 time: 0.100307 Dec 13 16:53:16.561132 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 321/638] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:16 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 28630 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:16.823247 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-315d878e-c5c0-4873-b27a-9973e82ea36c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:16.824242 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-315d878e-c5c0-4873-b27a-9973e82ea36c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:16.831638 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-315d878e-c5c0-4873-b27a-9973e82ea36c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:16.832289 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-315d878e-c5c0-4873-b27a-9973e82ea36c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:16.833095 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-315d878e-c5c0-4873-b27a-9973e82ea36c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:16.833517 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-315d878e-c5c0-4873-b27a-9973e82ea36c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:16.895182 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-315d878e-c5c0-4873-b27a-9973e82ea36c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.076117 Dec 13 16:53:16.895804 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 318/639] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:16 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:53:17.576630 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-301c03c2-7795-4841-8f15-369be5975bf4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:17.578275 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-301c03c2-7795-4841-8f15-369be5975bf4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:17.585270 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-301c03c2-7795-4841-8f15-369be5975bf4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:17.585756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-301c03c2-7795-4841-8f15-369be5975bf4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:17.586579 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-301c03c2-7795-4841-8f15-369be5975bf4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:17.587219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-301c03c2-7795-4841-8f15-369be5975bf4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:17.662590 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-301c03c2-7795-4841-8f15-369be5975bf4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 28630 microversion: 2.20 time: 0.091923 Dec 13 16:53:17.664307 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 322/640] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:17 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 28630 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:17.907363 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e2ae1467-b1c2-4f7e-8860-0ec002a0b196 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:17.908360 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e2ae1467-b1c2-4f7e-8860-0ec002a0b196 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:17.916430 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e2ae1467-b1c2-4f7e-8860-0ec002a0b196 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:17.917007 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e2ae1467-b1c2-4f7e-8860-0ec002a0b196 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:17.918205 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e2ae1467-b1c2-4f7e-8860-0ec002a0b196 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:17.919023 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e2ae1467-b1c2-4f7e-8860-0ec002a0b196 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:17.996332 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e2ae1467-b1c2-4f7e-8860-0ec002a0b196 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.092943 Dec 13 16:53:17.997397 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 319/641] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:17 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:53:18.675373 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-214cc6da-9969-4d4c-90d6-c431dd59e9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:18.676495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-214cc6da-9969-4d4c-90d6-c431dd59e9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:18.685296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-214cc6da-9969-4d4c-90d6-c431dd59e9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:18.688227 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-214cc6da-9969-4d4c-90d6-c431dd59e9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:18.689422 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-214cc6da-9969-4d4c-90d6-c431dd59e9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:18.690855 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-214cc6da-9969-4d4c-90d6-c431dd59e9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:18.756412 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-214cc6da-9969-4d4c-90d6-c431dd59e9b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 28630 microversion: 2.20 time: 0.085127 Dec 13 16:53:18.760028 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 323/642] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:18 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 28630 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:19.008152 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b00eebd7-0cd1-45e1-83b7-6dd933c9d5b2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:19.009965 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b00eebd7-0cd1-45e1-83b7-6dd933c9d5b2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:19.017240 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b00eebd7-0cd1-45e1-83b7-6dd933c9d5b2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:19.017717 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b00eebd7-0cd1-45e1-83b7-6dd933c9d5b2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:19.018509 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b00eebd7-0cd1-45e1-83b7-6dd933c9d5b2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:19.018943 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b00eebd7-0cd1-45e1-83b7-6dd933c9d5b2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:19.081406 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b00eebd7-0cd1-45e1-83b7-6dd933c9d5b2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.077397 Dec 13 16:53:19.085040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 320/643] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:19 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:53:19.771195 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f7336664-4a7f-4753-b7f6-8224cdb7f8ce tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:19.772210 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f7336664-4a7f-4753-b7f6-8224cdb7f8ce tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:19.787037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f7336664-4a7f-4753-b7f6-8224cdb7f8ce tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:19.787322 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f7336664-4a7f-4753-b7f6-8224cdb7f8ce tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:19.788293 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f7336664-4a7f-4753-b7f6-8224cdb7f8ce tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:19.788740 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f7336664-4a7f-4753-b7f6-8224cdb7f8ce tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:19.867669 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f7336664-4a7f-4753-b7f6-8224cdb7f8ce tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 30565 microversion: 2.20 time: 0.102417 Dec 13 16:53:19.868533 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 324/644] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:19 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 30565 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:20.093348 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a87a1dd7-d758-4a87-b49d-489f064120fd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:20.094456 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a87a1dd7-d758-4a87-b49d-489f064120fd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:20.103153 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a87a1dd7-d758-4a87-b49d-489f064120fd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:20.103769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a87a1dd7-d758-4a87-b49d-489f064120fd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:20.104833 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a87a1dd7-d758-4a87-b49d-489f064120fd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:20.105297 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a87a1dd7-d758-4a87-b49d-489f064120fd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:20.169424 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a87a1dd7-d758-4a87-b49d-489f064120fd tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.079887 Dec 13 16:53:20.172675 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 321/645] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:20 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:53:20.879961 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c4a6dd61-34ab-4c81-8987-9b02fa394df8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:20.881188 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c4a6dd61-34ab-4c81-8987-9b02fa394df8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:20.888790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd61-34ab-4c81-8987-9b02fa394df8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:20.889567 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd61-34ab-4c81-8987-9b02fa394df8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:20.890353 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd61-34ab-4c81-8987-9b02fa394df8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:20.891257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd61-34ab-4c81-8987-9b02fa394df8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:20.974663 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c4a6dd61-34ab-4c81-8987-9b02fa394df8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 32310 microversion: 2.20 time: 0.098591 Dec 13 16:53:20.976798 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 325/646] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:20 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 32310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:21.181468 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c1ac8b15-e202-4325-8f87-5ebe9fb5689f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:21.182478 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c1ac8b15-e202-4325-8f87-5ebe9fb5689f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:21.189691 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1ac8b15-e202-4325-8f87-5ebe9fb5689f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:21.190133 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1ac8b15-e202-4325-8f87-5ebe9fb5689f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:21.190920 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1ac8b15-e202-4325-8f87-5ebe9fb5689f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:21.191347 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c1ac8b15-e202-4325-8f87-5ebe9fb5689f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:21.255244 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c1ac8b15-e202-4325-8f87-5ebe9fb5689f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.078182 Dec 13 16:53:21.255895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 322/647] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:21 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:53:21.991444 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cdb154a1-783c-443b-91fa-6aed831e2633 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:21.994449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cdb154a1-783c-443b-91fa-6aed831e2633 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:22.002411 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdb154a1-783c-443b-91fa-6aed831e2633 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:22.002838 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdb154a1-783c-443b-91fa-6aed831e2633 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:22.003967 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdb154a1-783c-443b-91fa-6aed831e2633 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:22.004393 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdb154a1-783c-443b-91fa-6aed831e2633 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:22.078030 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cdb154a1-783c-443b-91fa-6aed831e2633 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 33364 microversion: 2.20 time: 0.093430 Dec 13 16:53:22.078683 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 326/648] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:21 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 33364 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:22.271441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-07cde4f9-a381-4cdb-a272-a90def6ae9d4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:22.274236 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-07cde4f9-a381-4cdb-a272-a90def6ae9d4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:22.283616 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-07cde4f9-a381-4cdb-a272-a90def6ae9d4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:22.284158 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-07cde4f9-a381-4cdb-a272-a90def6ae9d4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:22.285049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-07cde4f9-a381-4cdb-a272-a90def6ae9d4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:22.285552 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-07cde4f9-a381-4cdb-a272-a90def6ae9d4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:22.357800 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-07cde4f9-a381-4cdb-a272-a90def6ae9d4 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.093518 Dec 13 16:53:22.362832 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 323/649] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:22 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:53:23.091192 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-93d228b2-c969-4397-bc12-a7b52676cfa9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:23.092187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-93d228b2-c969-4397-bc12-a7b52676cfa9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:23.102978 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-93d228b2-c969-4397-bc12-a7b52676cfa9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:23.103540 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-93d228b2-c969-4397-bc12-a7b52676cfa9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:23.104350 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-93d228b2-c969-4397-bc12-a7b52676cfa9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:23.104840 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-93d228b2-c969-4397-bc12-a7b52676cfa9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:23.188308 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-93d228b2-c969-4397-bc12-a7b52676cfa9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 34509 microversion: 2.20 time: 0.101285 Dec 13 16:53:23.189058 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 327/650] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:23 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 34509 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:23.371058 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f642dd7d-7d55-4963-8749-52291505b7a8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:23.373150 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f642dd7d-7d55-4963-8749-52291505b7a8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:23.382154 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f642dd7d-7d55-4963-8749-52291505b7a8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:23.382726 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f642dd7d-7d55-4963-8749-52291505b7a8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:23.383971 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f642dd7d-7d55-4963-8749-52291505b7a8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:23.384750 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f642dd7d-7d55-4963-8749-52291505b7a8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:23.457999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f642dd7d-7d55-4963-8749-52291505b7a8 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.091005 Dec 13 16:53:23.459379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 324/651] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:23 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:53:24.202500 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-877575dd-2725-455d-930b-2f0c5aab471c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:24.204329 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-877575dd-2725-455d-930b-2f0c5aab471c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:24.214170 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-877575dd-2725-455d-930b-2f0c5aab471c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:24.214980 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-877575dd-2725-455d-930b-2f0c5aab471c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:24.215993 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-877575dd-2725-455d-930b-2f0c5aab471c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:24.216686 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-877575dd-2725-455d-930b-2f0c5aab471c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:24.324062 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-877575dd-2725-455d-930b-2f0c5aab471c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 35746 microversion: 2.20 time: 0.121286 Dec 13 16:53:24.328450 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 328/652] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:24 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 35746 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:24.472060 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1faa20ed-2520-451f-b138-2dac2cad3c0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:24.474202 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1faa20ed-2520-451f-b138-2dac2cad3c0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:24.499134 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1faa20ed-2520-451f-b138-2dac2cad3c0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:24.499604 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1faa20ed-2520-451f-b138-2dac2cad3c0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:24.500390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1faa20ed-2520-451f-b138-2dac2cad3c0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:24.507499 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1faa20ed-2520-451f-b138-2dac2cad3c0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:24.577933 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1faa20ed-2520-451f-b138-2dac2cad3c0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 14 microversion: 2.1 time: 0.110037 Dec 13 16:53:24.580525 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 325/653] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:24 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 13 16:53:25.336597 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-eded28d7-892c-499c-b5fb-da825fd9fd37 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:25.337880 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-eded28d7-892c-499c-b5fb-da825fd9fd37 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:25.358505 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eded28d7-892c-499c-b5fb-da825fd9fd37 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:25.359296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eded28d7-892c-499c-b5fb-da825fd9fd37 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:25.360320 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eded28d7-892c-499c-b5fb-da825fd9fd37 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:25.361441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eded28d7-892c-499c-b5fb-da825fd9fd37 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:25.472696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-eded28d7-892c-499c-b5fb-da825fd9fd37 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 37165 microversion: 2.20 time: 0.140535 Dec 13 16:53:25.478784 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 329/654] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:25 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 37165 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:25.590602 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b026c02b-6d32-4527-bbb9-0ecffcf5f57c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:25.592888 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b026c02b-6d32-4527-bbb9-0ecffcf5f57c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:25.609876 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b026c02b-6d32-4527-bbb9-0ecffcf5f57c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:25.610411 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b026c02b-6d32-4527-bbb9-0ecffcf5f57c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:25.614617 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b026c02b-6d32-4527-bbb9-0ecffcf5f57c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:25.615377 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b026c02b-6d32-4527-bbb9-0ecffcf5f57c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:25.728084 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b026c02b-6d32-4527-bbb9-0ecffcf5f57c tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 6795 microversion: 2.1 time: 0.142014 Dec 13 16:53:25.728857 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 326/655] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:25 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 6795 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:53:26.486034 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-12ca8231-1dc1-43c8-9030-15d25a5ba033 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:26.487046 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-12ca8231-1dc1-43c8-9030-15d25a5ba033 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:26.500434 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-12ca8231-1dc1-43c8-9030-15d25a5ba033 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:26.505109 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-12ca8231-1dc1-43c8-9030-15d25a5ba033 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:26.506151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-12ca8231-1dc1-43c8-9030-15d25a5ba033 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:26.506599 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-12ca8231-1dc1-43c8-9030-15d25a5ba033 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:26.612517 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-12ca8231-1dc1-43c8-9030-15d25a5ba033 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 38189 microversion: 2.20 time: 0.130369 Dec 13 16:53:26.614909 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 330/656] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:26 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 38189 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:26.740441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ce04e31a-c698-430a-9d36-ca64098a699a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:26.741474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ce04e31a-c698-430a-9d36-ca64098a699a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:26.749139 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ce04e31a-c698-430a-9d36-ca64098a699a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:26.749864 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ce04e31a-c698-430a-9d36-ca64098a699a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:26.750649 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ce04e31a-c698-430a-9d36-ca64098a699a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:26.751072 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ce04e31a-c698-430a-9d36-ca64098a699a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:26.832960 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ce04e31a-c698-430a-9d36-ca64098a699a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 15025 microversion: 2.1 time: 0.096855 Dec 13 16:53:26.834751 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 327/657] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:26 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 15025 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:27.626908 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-829a6523-5e35-48e1-8f82-2d5f6c8f761a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:27.628245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-829a6523-5e35-48e1-8f82-2d5f6c8f761a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:27.636738 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-829a6523-5e35-48e1-8f82-2d5f6c8f761a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:27.637189 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-829a6523-5e35-48e1-8f82-2d5f6c8f761a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:27.637989 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-829a6523-5e35-48e1-8f82-2d5f6c8f761a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:27.638421 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-829a6523-5e35-48e1-8f82-2d5f6c8f761a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:27.705120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-829a6523-5e35-48e1-8f82-2d5f6c8f761a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 38189 microversion: 2.20 time: 0.082291 Dec 13 16:53:27.705783 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 328/658] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:27 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 38189 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:27.776520 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0bbd6599-d22a-49ab-aa55-daaad2ee84de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Action: 'create', calling method: .version_select at 0x7f213bff8040>, body: {"keypair": {"name": "tempest-TestShelveInstance-920802042"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:27.792057 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-0bbd6599-d22a-49ab-aa55-daaad2ee84de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Getting quotas for project 979a51fd9c744bc9a5b0d82595603a56. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:53:27.796278 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-0bbd6599-d22a-49ab-aa55-daaad2ee84de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Getting quotas for user ec44be0e26b44a55910bdccc7c836d2b and project 979a51fd9c744bc9a5b0d82595603a56. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:53:27.963700 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-0bbd6599-d22a-49ab-aa55-daaad2ee84de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Getting quotas for project 979a51fd9c744bc9a5b0d82595603a56. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:53:27.967683 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-0bbd6599-d22a-49ab-aa55-daaad2ee84de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Getting quotas for user ec44be0e26b44a55910bdccc7c836d2b and project 979a51fd9c744bc9a5b0d82595603a56. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:53:27.968722 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5bde6302-4e9a-4938-95b4-0c9ba59d5097 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:27.970420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5bde6302-4e9a-4938-95b4-0c9ba59d5097 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:27.977609 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bde6302-4e9a-4938-95b4-0c9ba59d5097 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:27.978386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bde6302-4e9a-4938-95b4-0c9ba59d5097 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:27.979245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bde6302-4e9a-4938-95b4-0c9ba59d5097 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:27.979884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bde6302-4e9a-4938-95b4-0c9ba59d5097 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:27.980942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0bbd6599-d22a-49ab-aa55-daaad2ee84de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.384248 Dec 13 16:53:27.981534 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 331/659] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 13 16:53:27 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:28.056342 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5bde6302-4e9a-4938-95b4-0c9ba59d5097 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 18305 microversion: 2.1 time: 0.214551 Dec 13 16:53:28.057423 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 329/660] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:27 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 18305 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:53:28.717542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b1725def-cc04-4c80-94d7-e4615bacbf43 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:28.718587 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b1725def-cc04-4c80-94d7-e4615bacbf43 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:28.725374 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b1725def-cc04-4c80-94d7-e4615bacbf43 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:28.725796 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b1725def-cc04-4c80-94d7-e4615bacbf43 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:28.726782 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b1725def-cc04-4c80-94d7-e4615bacbf43 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:28.727231 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b1725def-cc04-4c80-94d7-e4615bacbf43 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:28.787935 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b1725def-cc04-4c80-94d7-e4615bacbf43 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 38189 microversion: 2.20 time: 0.074602 Dec 13 16:53:28.788719 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 332/661] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:28 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 38189 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:29.072317 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4178a2d6-e24d-4174-97f4-aa6d8731df53 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:29.073511 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4178a2d6-e24d-4174-97f4-aa6d8731df53 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:29.080817 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4178a2d6-e24d-4174-97f4-aa6d8731df53 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:29.080918 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4178a2d6-e24d-4174-97f4-aa6d8731df53 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:29.081639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4178a2d6-e24d-4174-97f4-aa6d8731df53 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:29.082063 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4178a2d6-e24d-4174-97f4-aa6d8731df53 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:29.174281 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4178a2d6-e24d-4174-97f4-aa6d8731df53 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 19342 microversion: 2.1 time: 0.109627 Dec 13 16:53:29.176286 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 330/662] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:29 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:29.801720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a04b4993-a6a9-4e66-af1e-17d521ac3ad8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:29.802700 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a04b4993-a6a9-4e66-af1e-17d521ac3ad8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:29.810747 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a04b4993-a6a9-4e66-af1e-17d521ac3ad8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:29.811320 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a04b4993-a6a9-4e66-af1e-17d521ac3ad8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:29.812149 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a04b4993-a6a9-4e66-af1e-17d521ac3ad8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:29.812600 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a04b4993-a6a9-4e66-af1e-17d521ac3ad8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:29.887878 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a04b4993-a6a9-4e66-af1e-17d521ac3ad8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 38206 microversion: 2.20 time: 0.090563 Dec 13 16:53:29.888875 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 333/663] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:29 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 38206 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:30.186961 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c47fb5a4-9345-4f4e-92fc-5d36aafd6a83 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:30.187952 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c47fb5a4-9345-4f4e-92fc-5d36aafd6a83 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:30.195400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c47fb5a4-9345-4f4e-92fc-5d36aafd6a83 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:30.195934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c47fb5a4-9345-4f4e-92fc-5d36aafd6a83 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:30.196893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c47fb5a4-9345-4f4e-92fc-5d36aafd6a83 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:30.197365 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c47fb5a4-9345-4f4e-92fc-5d36aafd6a83 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:30.280100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c47fb5a4-9345-4f4e-92fc-5d36aafd6a83 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 22168 microversion: 2.1 time: 0.097016 Dec 13 16:53:30.280749 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 331/664] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:30 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 22168 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:31.014928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c2d59ba9-3bc7-41d9-9add-9f9d14799c6a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:31.015944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c2d59ba9-3bc7-41d9-9add-9f9d14799c6a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:31.023922 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c2d59ba9-3bc7-41d9-9add-9f9d14799c6a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:31.025095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c2d59ba9-3bc7-41d9-9add-9f9d14799c6a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:31.025902 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c2d59ba9-3bc7-41d9-9add-9f9d14799c6a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:31.026338 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c2d59ba9-3bc7-41d9-9add-9f9d14799c6a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:31.120153 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c2d59ba9-3bc7-41d9-9add-9f9d14799c6a tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 200 len: 38332 microversion: 2.20 time: 0.222511 Dec 13 16:53:31.121841 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 334/665] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:30 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 38332 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:53:31.142441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6c08b80f-55d8-4424-b1a4-51005f0f1216 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:31.144094 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6c08b80f-55d8-4424-b1a4-51005f0f1216 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:31.156000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-55d8-4424-b1a4-51005f0f1216 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:31.156687 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-55d8-4424-b1a4-51005f0f1216 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:31.158161 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-55d8-4424-b1a4-51005f0f1216 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:31.158878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-55d8-4424-b1a4-51005f0f1216 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:31.209264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6c08b80f-55d8-4424-b1a4-51005f0f1216 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/ips" status: 200 len: 152 microversion: 2.20 time: 0.076956 Dec 13 16:53:31.210485 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 332/666] 10.222.0.62 () {60 vars in 1288 bytes} [Mon Dec 13 16:53:31 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/ips => generated 152 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:31.325576 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-31b03d17-ef64-47ea-b110-59738f18fbdc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:31.328117 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-31b03d17-ef64-47ea-b110-59738f18fbdc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:31.343344 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-31b03d17-ef64-47ea-b110-59738f18fbdc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:31.343795 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-31b03d17-ef64-47ea-b110-59738f18fbdc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:31.344613 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-31b03d17-ef64-47ea-b110-59738f18fbdc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:31.345049 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-31b03d17-ef64-47ea-b110-59738f18fbdc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:31.485646 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-31b03d17-ef64-47ea-b110-59738f18fbdc tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 23803 microversion: 2.1 time: 0.188519 Dec 13 16:53:31.488297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 335/667] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:31 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 23803 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:32.502057 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-519e26a9-3195-417d-8e9c-dab8bf4e7972 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:32.503179 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-519e26a9-3195-417d-8e9c-dab8bf4e7972 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:32.510694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-519e26a9-3195-417d-8e9c-dab8bf4e7972 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:32.511141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-519e26a9-3195-417d-8e9c-dab8bf4e7972 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:32.511929 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-519e26a9-3195-417d-8e9c-dab8bf4e7972 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:32.512360 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-519e26a9-3195-417d-8e9c-dab8bf4e7972 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:32.588147 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-519e26a9-3195-417d-8e9c-dab8bf4e7972 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 25047 microversion: 2.1 time: 0.089716 Dec 13 16:53:32.588851 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 333/668] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:32 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 25047 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:33.583609 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ab6ab65d-4e3d-4690-bf23-5a62da66891e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:33.584249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ab6ab65d-4e3d-4690-bf23-5a62da66891e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:33.591572 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ab6ab65d-4e3d-4690-bf23-5a62da66891e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:33.591990 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ab6ab65d-4e3d-4690-bf23-5a62da66891e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:33.592855 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ab6ab65d-4e3d-4690-bf23-5a62da66891e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:33.593292 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ab6ab65d-4e3d-4690-bf23-5a62da66891e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:33.600286 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d7072179-cebc-4bdb-b425-51e532864b3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:33.601486 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d7072179-cebc-4bdb-b425-51e532864b3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:33.609452 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d7072179-cebc-4bdb-b425-51e532864b3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:33.609941 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d7072179-cebc-4bdb-b425-51e532864b3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:33.610898 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d7072179-cebc-4bdb-b425-51e532864b3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:33.611341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d7072179-cebc-4bdb-b425-51e532864b3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:33.625616 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-ab6ab65d-4e3d-4690-bf23-5a62da66891e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lazy-loading 'flavor' on Instance uuid 3ea34650-4715-472f-a562-e8929cb0f319 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:53:33.690320 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d7072179-cebc-4bdb-b425-51e532864b3a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 26426 microversion: 2.1 time: 0.093530 Dec 13 16:53:33.692423 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 334/669] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:33 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 26426 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:53:33.956347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ab6ab65d-4e3d-4690-bf23-5a62da66891e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 202 len: 0 microversion: 2.20 time: 0.377260 Dec 13 16:53:33.957504 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 336/670] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:53:33 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:53:33.968008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:33.968722 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:33.978585 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:33.978939 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:33.981662 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:33.982200 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:34.151400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:34.161524 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:34.162998 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:34.164187 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8d316f4a-a5c7-464a-84c6-c54397478378 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.201117 Dec 13 16:53:34.164806 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 335/671] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:33 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:34.704400 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a220be98-023c-4464-9aba-52a2dda4e1e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:34.705423 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a220be98-023c-4464-9aba-52a2dda4e1e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:34.712466 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a220be98-023c-4464-9aba-52a2dda4e1e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:34.713140 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a220be98-023c-4464-9aba-52a2dda4e1e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:34.713927 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a220be98-023c-4464-9aba-52a2dda4e1e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:34.714354 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a220be98-023c-4464-9aba-52a2dda4e1e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:34.794853 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a220be98-023c-4464-9aba-52a2dda4e1e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 27336 microversion: 2.1 time: 0.094847 Dec 13 16:53:34.795511 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 337/672] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:34 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 27336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:35.185843 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:35.186448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:35.193837 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:35.194277 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:35.195073 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:35.195496 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:35.351902 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:35.361349 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:35.363301 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:35.364499 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d08fa754-f4bc-41de-b332-e156ce34a3cd tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.182473 Dec 13 16:53:35.365190 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 336/673] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:35 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:35.809464 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6febd89a-1277-4f7e-9722-44700504efab tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:35.810570 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6febd89a-1277-4f7e-9722-44700504efab tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:35.818073 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6febd89a-1277-4f7e-9722-44700504efab tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:35.818498 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6febd89a-1277-4f7e-9722-44700504efab tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:35.819282 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6febd89a-1277-4f7e-9722-44700504efab tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:35.819715 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6febd89a-1277-4f7e-9722-44700504efab tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:35.895825 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6febd89a-1277-4f7e-9722-44700504efab tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 27746 microversion: 2.1 time: 0.090466 Dec 13 16:53:35.896502 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 338/674] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:35 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 27746 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:36.383400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:36.384133 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:36.390976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:36.391420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:36.392191 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:36.392631 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:36.552133 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:36.560702 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:36.562197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:36.563359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-76c8c770-3510-413c-a3a0-2922bc514b24 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.183772 Dec 13 16:53:36.563931 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 337/675] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:36 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:36.908611 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5b856db1-cd9a-435e-aadc-655a70b280ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:36.909621 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5b856db1-cd9a-435e-aadc-655a70b280ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:36.917007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b856db1-cd9a-435e-aadc-655a70b280ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:36.917449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b856db1-cd9a-435e-aadc-655a70b280ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:36.918236 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b856db1-cd9a-435e-aadc-655a70b280ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:36.918663 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b856db1-cd9a-435e-aadc-655a70b280ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:37.002994 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5b856db1-cd9a-435e-aadc-655a70b280ef tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 28049 microversion: 2.1 time: 0.097791 Dec 13 16:53:37.003819 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 339/676] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:36 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 28049 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:37.583257 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:37.583814 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:37.590923 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:37.591463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:37.592438 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:37.593371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:37.755771 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:37.767930 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:37.770042 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:37.771226 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-819e21ea-4254-46cd-8fcf-9b2cda27b576 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.191955 Dec 13 16:53:37.771794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 338/677] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:37 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:38.016734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-711fcca0-4cc6-4ebe-88a4-c54ffb47c91d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:38.017833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-711fcca0-4cc6-4ebe-88a4-c54ffb47c91d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:38.025245 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-711fcca0-4cc6-4ebe-88a4-c54ffb47c91d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:38.025691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-711fcca0-4cc6-4ebe-88a4-c54ffb47c91d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:38.026469 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-711fcca0-4cc6-4ebe-88a4-c54ffb47c91d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:38.026898 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-711fcca0-4cc6-4ebe-88a4-c54ffb47c91d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:38.109841 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-711fcca0-4cc6-4ebe-88a4-c54ffb47c91d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 28174 microversion: 2.1 time: 0.097551 Dec 13 16:53:38.110489 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 340/678] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:38 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 28174 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:38.790991 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:38.791579 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:38.799236 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:38.799683 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:38.800466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:38.800926 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:38.955303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:38.964379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:38.965890 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:38.967429 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6c6b5bb6-5b83-4cdf-b970-3f9be66eee0d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.180951 Dec 13 16:53:38.967989 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 339/679] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:38 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:39.122755 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a61d7769-4c26-433a-bc60-3e4076d4fe0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:39.123835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a61d7769-4c26-433a-bc60-3e4076d4fe0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:39.131849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a61d7769-4c26-433a-bc60-3e4076d4fe0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:39.132305 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a61d7769-4c26-433a-bc60-3e4076d4fe0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:39.133174 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a61d7769-4c26-433a-bc60-3e4076d4fe0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:39.133608 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a61d7769-4c26-433a-bc60-3e4076d4fe0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:39.217602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a61d7769-4c26-433a-bc60-3e4076d4fe0d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 28385 microversion: 2.1 time: 0.098649 Dec 13 16:53:39.218147 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 341/680] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:39 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 28385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:39.992486 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:39.993096 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:40.000206 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:40.000700 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:40.001740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:40.002185 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:40.167858 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:40.178311 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:40.179787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:40.180980 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9db79e1c-e3a3-4280-ab28-f6994139f08c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.192303 Dec 13 16:53:40.181542 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 340/681] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:39 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:40.232947 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b7a67980-a486-4526-85a3-73a9878495e7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:40.234168 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b7a67980-a486-4526-85a3-73a9878495e7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:40.242405 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b7a67980-a486-4526-85a3-73a9878495e7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:40.242844 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b7a67980-a486-4526-85a3-73a9878495e7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:40.243610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b7a67980-a486-4526-85a3-73a9878495e7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:40.244038 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b7a67980-a486-4526-85a3-73a9878495e7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:40.325211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b7a67980-a486-4526-85a3-73a9878495e7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 28465 microversion: 2.1 time: 0.097922 Dec 13 16:53:40.325985 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 342/682] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:40 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 28465 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:41.206246 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:41.206866 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:41.213363 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:41.213802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:41.214580 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:41.215000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:41.339037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a1b1bbd3-4c14-43c9-8c90-b805b3c27cac tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:41.340026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a1b1bbd3-4c14-43c9-8c90-b805b3c27cac tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:41.347742 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1b1bbd3-4c14-43c9-8c90-b805b3c27cac tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:41.348175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1b1bbd3-4c14-43c9-8c90-b805b3c27cac tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:41.348974 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1b1bbd3-4c14-43c9-8c90-b805b3c27cac tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:41.352070 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:41.353076 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1b1bbd3-4c14-43c9-8c90-b805b3c27cac tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:41.359953 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:41.361441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:41.363159 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-880b5b12-72ee-45bb-b97c-cea3e8f45607 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.167600 Dec 13 16:53:41.363810 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 341/683] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:41 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:41.436594 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a1b1bbd3-4c14-43c9-8c90-b805b3c27cac tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 28633 microversion: 2.1 time: 0.101527 Dec 13 16:53:41.437329 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 343/684] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:41 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 28633 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:42.097496 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 16:53:42.097496 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 16:53:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 16:53:42.384522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:42.385115 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:42.394636 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:42.395075 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:42.395839 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:42.396258 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:42.448844 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7fa39533-70f6-482c-b3f0-203526728371 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:42.449869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7fa39533-70f6-482c-b3f0-203526728371 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:42.457570 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7fa39533-70f6-482c-b3f0-203526728371 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:42.458006 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7fa39533-70f6-482c-b3f0-203526728371 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:42.458758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7fa39533-70f6-482c-b3f0-203526728371 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:42.459179 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7fa39533-70f6-482c-b3f0-203526728371 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:42.524258 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7fa39533-70f6-482c-b3f0-203526728371 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 28633 microversion: 2.1 time: 0.079213 Dec 13 16:53:42.525701 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 344/685] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:42 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 28633 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:53:42.548193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:42.557110 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:42.559761 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:42.561894 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b99d37c1-f212-4e89-964b-15f1f9d219ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.182696 Dec 13 16:53:42.562939 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 342/686] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:42 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:43.536682 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a2845cce-f781-4d7e-b70d-e59cd0f0330b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:43.537621 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a2845cce-f781-4d7e-b70d-e59cd0f0330b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:43.544821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2845cce-f781-4d7e-b70d-e59cd0f0330b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:43.545263 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2845cce-f781-4d7e-b70d-e59cd0f0330b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:43.546039 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2845cce-f781-4d7e-b70d-e59cd0f0330b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:43.546459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2845cce-f781-4d7e-b70d-e59cd0f0330b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:43.585176 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:43.586079 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:43.595575 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:43.596014 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:43.597156 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:43.597776 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:43.612527 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a2845cce-f781-4d7e-b70d-e59cd0f0330b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 28633 microversion: 2.1 time: 0.079811 Dec 13 16:53:43.617571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 345/687] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:43 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 28633 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:43.748542 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:43.758625 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:43.760108 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:43.761330 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-eebfd7c4-0844-4006-b1fb-ca89358f3b27 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.181021 Dec 13 16:53:43.761897 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 343/688] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:43 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:44.628652 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1804f8f4-bad3-4286-b898-b1ef9daafb2f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:44.629670 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1804f8f4-bad3-4286-b898-b1ef9daafb2f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:44.638112 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1804f8f4-bad3-4286-b898-b1ef9daafb2f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:44.638790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1804f8f4-bad3-4286-b898-b1ef9daafb2f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:44.639873 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1804f8f4-bad3-4286-b898-b1ef9daafb2f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:44.640563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1804f8f4-bad3-4286-b898-b1ef9daafb2f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:44.707334 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1804f8f4-bad3-4286-b898-b1ef9daafb2f tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 28633 microversion: 2.1 time: 0.084065 Dec 13 16:53:44.707996 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 346/689] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:44 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 28633 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:44.779542 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:44.780154 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:44.786745 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:44.787193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:44.788597 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:44.789054 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:44.946859 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:44.955584 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:44.957094 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:44.958282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7e2d6f8b-80d3-49ca-9663-99d54ec8e031 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1745 microversion: 2.20 time: 0.182551 Dec 13 16:53:44.958843 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 344/690] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:44 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:45.438586 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-136909848", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-920802042", "security_groups": [{"name": "tempest-secgroup-smoke-1323176308"}], "networks": [{"uuid": "4a929df9-a7b8-43e3-bded-233e4737abcd"}], "block_device_mapping_v2": [{"uuid": "799b6790-b5d2-4f92-bd87-1c867e73846f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:45.568010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] validate_networks() for [('4a929df9-a7b8-43e3-bded-233e4737abcd', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:53:45.719346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-844c2616-60dc-4482-bb77-6186782fcfca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:45.720260 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-844c2616-60dc-4482-bb77-6186782fcfca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:45.726692 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-844c2616-60dc-4482-bb77-6186782fcfca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:45.727136 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-844c2616-60dc-4482-bb77-6186782fcfca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:45.727918 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-844c2616-60dc-4482-bb77-6186782fcfca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:45.728346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-844c2616-60dc-4482-bb77-6186782fcfca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:45.813720 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-844c2616-60dc-4482-bb77-6186782fcfca tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 29368 microversion: 2.1 time: 0.097883 Dec 13 16:53:45.814431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 345/691] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:45 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 29368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:53:45.979343 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:45.980038 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:45.987852 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:45.988289 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:45.989195 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:45.989625 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:46.058497 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:53:46.059010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:53:46.059402 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:53:46.060345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:53:46.060814 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:53:46.069870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:46.070437 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:46.071286 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:46.071873 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:46.092650 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Getting quotas for project 979a51fd9c744bc9a5b0d82595603a56. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:53:46.096983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Getting quotas for user ec44be0e26b44a55910bdccc7c836d2b and project 979a51fd9c744bc9a5b0d82595603a56. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:53:46.136125 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:46.144589 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:46.146153 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:46.147360 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-59b825ea-4837-41fb-a849-23c154a70d4d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1745 microversion: 2.20 time: 0.173308 Dec 13 16:53:46.147877 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 346/692] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:45 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:53:46.160432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:53:46.162740 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='799b6790-b5d2-4f92-bd87-1c867e73846f',volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:53:46.309926 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-827aec85-b0a0-4222-95de-c8e383002693 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.876699 Dec 13 16:53:46.310691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 347/693] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:53:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:53:46.326418 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-13736eba-cc9e-45c3-b091-9967c77d29c1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:46.327101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-13736eba-cc9e-45c3-b091-9967c77d29c1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:46.389728 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-13736eba-cc9e-45c3-b091-9967c77d29c1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:46.400290 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-13736eba-cc9e-45c3-b091-9967c77d29c1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1087 microversion: 2.1 time: 0.082967 Dec 13 16:53:46.406330 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 347/694] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:46 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1087 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:46.826751 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c956b5c1-269e-49df-837c-761e5654da3e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:46.827734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c956b5c1-269e-49df-837c-761e5654da3e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:46.834828 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c956b5c1-269e-49df-837c-761e5654da3e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:46.835608 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c956b5c1-269e-49df-837c-761e5654da3e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:46.836345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c956b5c1-269e-49df-837c-761e5654da3e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:46.836803 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c956b5c1-269e-49df-837c-761e5654da3e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:46.927557 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c956b5c1-269e-49df-837c-761e5654da3e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 30541 microversion: 2.1 time: 0.104922 Dec 13 16:53:46.931712 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 348/695] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:46 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 30541 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:47.167473 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:47.168042 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:47.174729 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:47.175174 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:47.175948 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:47.176373 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:47.342706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:47.354026 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:47.355543 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:47.356877 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e792e6e4-fa02-4d87-acdc-91e5496ab960 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1745 microversion: 2.20 time: 0.193847 Dec 13 16:53:47.357455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 348/696] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:47 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1745 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:47.423655 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8c11fb08-5778-4595-8d01-4e9651829a45 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:47.424391 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8c11fb08-5778-4595-8d01-4e9651829a45 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:47.432678 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8c11fb08-5778-4595-8d01-4e9651829a45 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:47.433409 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8c11fb08-5778-4595-8d01-4e9651829a45 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:47.434327 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8c11fb08-5778-4595-8d01-4e9651829a45 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:47.434869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8c11fb08-5778-4595-8d01-4e9651829a45 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:47.508366 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8c11fb08-5778-4595-8d01-4e9651829a45 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:47.518041 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8c11fb08-5778-4595-8d01-4e9651829a45 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1185 microversion: 2.1 time: 0.098236 Dec 13 16:53:47.518335 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 349/697] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:47 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:47.940083 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5d273082-4cfd-415f-b8f5-9a4f8b2683c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:47.945268 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5d273082-4cfd-415f-b8f5-9a4f8b2683c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:47.948937 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d273082-4cfd-415f-b8f5-9a4f8b2683c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:47.949463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d273082-4cfd-415f-b8f5-9a4f8b2683c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:47.950329 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d273082-4cfd-415f-b8f5-9a4f8b2683c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:47.951288 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5d273082-4cfd-415f-b8f5-9a4f8b2683c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:48.038100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5d273082-4cfd-415f-b8f5-9a4f8b2683c3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 32298 microversion: 2.1 time: 0.101176 Dec 13 16:53:48.039008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 349/698] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:47 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 32298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:48.377376 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:48.377982 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:48.386690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:48.387129 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:48.397835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:48.398967 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:48.485664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-9ba3aa86-5caa-45aa-8704-cf79bb5d327b req-244f1f42-121b-418f-ab86-389e8bf35df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea34650-4715-472f-a562-e8929cb0f319", "name": "network-vif-plugged", "status": "completed", "tag": "823c9158-6eee-4748-8e22-293145c6db04"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:48.489098 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:53:48.489098 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:53:48.505413 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-9ba3aa86-5caa-45aa-8704-cf79bb5d327b req-244f1f42-121b-418f-ab86-389e8bf35df7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:48.506251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-9ba3aa86-5caa-45aa-8704-cf79bb5d327b req-244f1f42-121b-418f-ab86-389e8bf35df7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:48.540375 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-9ba3aa86-5caa-45aa-8704-cf79bb5d327b req-244f1f42-121b-418f-ab86-389e8bf35df7 service nova] Creating event network-vif-plugged:823c9158-6eee-4748-8e22-293145c6db04 for instance 3ea34650-4715-472f-a562-e8929cb0f319 on hv-cinder-82160 Dec 13 16:53:48.555422 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-9ba3aa86-5caa-45aa-8704-cf79bb5d327b req-244f1f42-121b-418f-ab86-389e8bf35df7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073267 Dec 13 16:53:48.572359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 350/699] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:53:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:53:48.581461 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c90c510e-44cb-48b8-bd78-a2aed287779a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:48.582404 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c90c510e-44cb-48b8-bd78-a2aed287779a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:48.594303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c90c510e-44cb-48b8-bd78-a2aed287779a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:48.595067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c90c510e-44cb-48b8-bd78-a2aed287779a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:48.596250 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c90c510e-44cb-48b8-bd78-a2aed287779a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:48.596893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c90c510e-44cb-48b8-bd78-a2aed287779a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:48.783206 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:48.796184 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:48.797767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:48.798921 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3dcd0da4-fc63-4b8a-ab7d-0f68c87f43dc tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.425405 Dec 13 16:53:48.799691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 350/700] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:48 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:48.865974 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c90c510e-44cb-48b8-bd78-a2aed287779a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:48.886864 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c90c510e-44cb-48b8-bd78-a2aed287779a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.313008 Dec 13 16:53:48.887471 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 351/701] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:48 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:49.050688 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4f5ca95a-e32f-45f0-b3f1-4713aa9608ff tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:49.052924 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4f5ca95a-e32f-45f0-b3f1-4713aa9608ff tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:49.060509 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f5ca95a-e32f-45f0-b3f1-4713aa9608ff tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:49.061307 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f5ca95a-e32f-45f0-b3f1-4713aa9608ff tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:49.062172 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f5ca95a-e32f-45f0-b3f1-4713aa9608ff tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:49.062623 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f5ca95a-e32f-45f0-b3f1-4713aa9608ff tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:49.151398 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4f5ca95a-e32f-45f0-b3f1-4713aa9608ff tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 33554 microversion: 2.1 time: 0.104555 Dec 13 16:53:49.160639 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 351/702] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:49 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 33554 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:49.819141 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:49.819843 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:49.821015 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-50a9d353-04ed-4bef-80a7-e5441e4f9fe5 req-d1f6e87f-6a7e-4f1a-ad9b-613ab7194dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895f7640-e4b3-4cb0-9632-d99cef54dab6", "tag": "7bfe5c97-83ad-4a06-b866-31455cbfdf29"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:49.824479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:53:49.824479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:53:49.831407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:49.832114 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:49.833423 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:49.834009 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:49.846125 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-50a9d353-04ed-4bef-80a7-e5441e4f9fe5 req-d1f6e87f-6a7e-4f1a-ad9b-613ab7194dc7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:49.846746 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-50a9d353-04ed-4bef-80a7-e5441e4f9fe5 req-d1f6e87f-6a7e-4f1a-ad9b-613ab7194dc7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:49.871166 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-50a9d353-04ed-4bef-80a7-e5441e4f9fe5 req-d1f6e87f-6a7e-4f1a-ad9b-613ab7194dc7 service nova] Creating event network-changed:7bfe5c97-83ad-4a06-b866-31455cbfdf29 for instance 895f7640-e4b3-4cb0-9632-d99cef54dab6 on hv-cinder-82160 Dec 13 16:53:49.885986 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-50a9d353-04ed-4bef-80a7-e5441e4f9fe5 req-d1f6e87f-6a7e-4f1a-ad9b-613ab7194dc7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211699 Dec 13 16:53:49.888508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 352/703] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:53:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:53:49.906420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-38deda56-4a2e-45c4-b901-ffc9b8e32e29 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:49.911978 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-38deda56-4a2e-45c4-b901-ffc9b8e32e29 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:49.923278 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-38deda56-4a2e-45c4-b901-ffc9b8e32e29 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:49.924186 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-38deda56-4a2e-45c4-b901-ffc9b8e32e29 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:49.925644 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-38deda56-4a2e-45c4-b901-ffc9b8e32e29 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:49.926246 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-38deda56-4a2e-45c4-b901-ffc9b8e32e29 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:50.101574 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-38deda56-4a2e-45c4-b901-ffc9b8e32e29 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:50.109893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-38deda56-4a2e-45c4-b901-ffc9b8e32e29 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.207924 Dec 13 16:53:50.127593 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 353/704] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:49 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:50.167769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e7ad4b2b-50f2-4db9-a360-25f6a0a9762e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:50.168722 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e7ad4b2b-50f2-4db9-a360-25f6a0a9762e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:50.175157 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e7ad4b2b-50f2-4db9-a360-25f6a0a9762e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:50.175599 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e7ad4b2b-50f2-4db9-a360-25f6a0a9762e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:50.176508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e7ad4b2b-50f2-4db9-a360-25f6a0a9762e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:50.189673 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e7ad4b2b-50f2-4db9-a360-25f6a0a9762e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:50.213040 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:50.221620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:50.223100 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:50.224255 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-790e960d-4d0b-4caa-928d-f4ccaa26a9f9 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.409315 Dec 13 16:53:50.227767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 352/705] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:49 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:50.287802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e7ad4b2b-50f2-4db9-a360-25f6a0a9762e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 34635 microversion: 2.1 time: 0.121792 Dec 13 16:53:50.289239 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 354/706] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:50 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 34635 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 13 16:53:51.139132 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b123d6a5-6ca8-42f0-9285-e134476c300c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:51.140467 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b123d6a5-6ca8-42f0-9285-e134476c300c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:51.156211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b123d6a5-6ca8-42f0-9285-e134476c300c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:51.156944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b123d6a5-6ca8-42f0-9285-e134476c300c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:51.157863 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b123d6a5-6ca8-42f0-9285-e134476c300c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:51.158569 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b123d6a5-6ca8-42f0-9285-e134476c300c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:51.243859 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:51.244562 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:51.261203 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:51.261571 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:51.262374 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:51.262808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:51.359758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-b123d6a5-6ca8-42f0-9285-e134476c300c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:51.376130 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b123d6a5-6ca8-42f0-9285-e134476c300c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.243704 Dec 13 16:53:51.386430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 353/707] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:51 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:51.386430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0635aaa4-94f2-4b2f-944c-163bc634f7ed tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:51.387676 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0635aaa4-94f2-4b2f-944c-163bc634f7ed tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:51.398336 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0635aaa4-94f2-4b2f-944c-163bc634f7ed tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:51.399364 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0635aaa4-94f2-4b2f-944c-163bc634f7ed tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:51.400122 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0635aaa4-94f2-4b2f-944c-163bc634f7ed tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:51.400597 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0635aaa4-94f2-4b2f-944c-163bc634f7ed tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:51.440122 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:51.449862 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:51.451441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:51.453351 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-cf778efa-72c6-459f-ae28-83a6e27f7ed5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.213432 Dec 13 16:53:51.453991 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 355/708] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:51 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:51.484454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0635aaa4-94f2-4b2f-944c-163bc634f7ed tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 35706 microversion: 2.1 time: 0.099935 Dec 13 16:53:51.484454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 354/709] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:51 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 35706 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:52.396136 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-031207ae-8b05-47bb-97f6-0e9ab233d4de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:52.397234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-031207ae-8b05-47bb-97f6-0e9ab233d4de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:52.414291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-031207ae-8b05-47bb-97f6-0e9ab233d4de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:52.415058 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-031207ae-8b05-47bb-97f6-0e9ab233d4de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:52.416521 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-031207ae-8b05-47bb-97f6-0e9ab233d4de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:52.417406 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-031207ae-8b05-47bb-97f6-0e9ab233d4de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:52.472767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:52.473450 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:52.484205 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:52.484553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:52.485409 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:52.485848 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:52.643808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-031207ae-8b05-47bb-97f6-0e9ab233d4de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:52.654211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-031207ae-8b05-47bb-97f6-0e9ab233d4de tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.263942 Dec 13 16:53:52.657534 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 356/710] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:52 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:52.663973 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0a2ba179-0e97-41cb-8486-5aadad5c8a49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:52.665294 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0a2ba179-0e97-41cb-8486-5aadad5c8a49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:52.673208 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0a2ba179-0e97-41cb-8486-5aadad5c8a49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:52.673920 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0a2ba179-0e97-41cb-8486-5aadad5c8a49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:52.674929 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0a2ba179-0e97-41cb-8486-5aadad5c8a49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:52.675366 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0a2ba179-0e97-41cb-8486-5aadad5c8a49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:52.718768 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:52.728612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:52.730307 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:52.731526 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-18abe128-dc54-4ca1-b1df-79464c7b28b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.263618 Dec 13 16:53:52.732285 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 355/711] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:52 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:52.771984 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0a2ba179-0e97-41cb-8486-5aadad5c8a49 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 37615 microversion: 2.1 time: 0.115400 Dec 13 16:53:52.772393 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 357/712] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:52 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 37615 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:53.671842 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-dcc5ba38-e0df-4d6e-8431-dd2e6a0c553d tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:53.673087 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-dcc5ba38-e0df-4d6e-8431-dd2e6a0c553d tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:53.680608 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dcc5ba38-e0df-4d6e-8431-dd2e6a0c553d tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:53.681197 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dcc5ba38-e0df-4d6e-8431-dd2e6a0c553d tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:53.681994 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dcc5ba38-e0df-4d6e-8431-dd2e6a0c553d tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:53.683040 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dcc5ba38-e0df-4d6e-8431-dd2e6a0c553d tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:53.759972 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:53.761064 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:53.770356 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:53.771185 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:53.773077 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:53.774144 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:53.897489 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-dcc5ba38-e0df-4d6e-8431-dd2e6a0c553d tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:53.914166 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-dcc5ba38-e0df-4d6e-8431-dd2e6a0c553d tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.246316 Dec 13 16:53:53.915049 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 356/713] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:53 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:53.936769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-57cf9abb-36bd-49f1-a920-145b39a50c56 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:53.936769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-57cf9abb-36bd-49f1-a920-145b39a50c56 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:53.948563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-57cf9abb-36bd-49f1-a920-145b39a50c56 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:53.949027 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-57cf9abb-36bd-49f1-a920-145b39a50c56 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:53.955184 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-57cf9abb-36bd-49f1-a920-145b39a50c56 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:53.955638 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-57cf9abb-36bd-49f1-a920-145b39a50c56 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:53.964142 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:53.976796 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:53.980126 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:53.982460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c5f5d16d-ef89-41fe-97d2-299928c385f4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.233375 Dec 13 16:53:53.983647 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 358/714] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:53 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:54.069478 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-57cf9abb-36bd-49f1-a920-145b39a50c56 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 38166 microversion: 2.1 time: 0.142412 Dec 13 16:53:54.071871 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 357/715] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:53 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 38166 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:54.931844 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e6370967-628f-459b-bf50-eae05597d794 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:54.932444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e6370967-628f-459b-bf50-eae05597d794 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:54.944686 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e6370967-628f-459b-bf50-eae05597d794 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:54.945251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e6370967-628f-459b-bf50-eae05597d794 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:54.946162 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e6370967-628f-459b-bf50-eae05597d794 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:54.946597 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e6370967-628f-459b-bf50-eae05597d794 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:55.006566 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:55.007787 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:55.023883 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:55.024324 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:55.025161 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:55.025594 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:55.159319 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e6370967-628f-459b-bf50-eae05597d794 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:55.169308 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e6370967-628f-459b-bf50-eae05597d794 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.241649 Dec 13 16:53:55.174355 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 359/716] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:54 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:55.181727 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b0024a0b-4f52-453d-8cfc-75e6a0f2bd86 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:55.182942 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b0024a0b-4f52-453d-8cfc-75e6a0f2bd86 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:55.190550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b0024a0b-4f52-453d-8cfc-75e6a0f2bd86 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:55.191308 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b0024a0b-4f52-453d-8cfc-75e6a0f2bd86 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:55.191783 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b0024a0b-4f52-453d-8cfc-75e6a0f2bd86 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:55.192211 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b0024a0b-4f52-453d-8cfc-75e6a0f2bd86 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:55.208545 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:55.218821 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:55.220389 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:55.221733 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-17178bec-8489-4d52-b36c-de1b50489175 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.220457 Dec 13 16:53:55.222769 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 358/717] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:54 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:55.268125 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b0024a0b-4f52-453d-8cfc-75e6a0f2bd86 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 38166 microversion: 2.1 time: 0.092351 Dec 13 16:53:55.269101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 360/718] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:55 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 38166 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:56.189447 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2cbc897f-7691-419a-854f-2591cdd6344b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:56.190879 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2cbc897f-7691-419a-854f-2591cdd6344b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:56.198828 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cbc897f-7691-419a-854f-2591cdd6344b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:56.199379 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cbc897f-7691-419a-854f-2591cdd6344b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:56.200249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cbc897f-7691-419a-854f-2591cdd6344b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:56.200779 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cbc897f-7691-419a-854f-2591cdd6344b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:56.241306 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:56.242235 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:56.254482 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:56.255034 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:56.255923 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:56.256418 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:56.419748 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2cbc897f-7691-419a-854f-2591cdd6344b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:56.429967 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2cbc897f-7691-419a-854f-2591cdd6344b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.244322 Dec 13 16:53:56.442171 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 359/719] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:56 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:56.442171 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f80d3f93-ba1f-46e6-9f4e-95a6fd66d434 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:56.442171 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f80d3f93-ba1f-46e6-9f4e-95a6fd66d434 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:56.449456 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f80d3f93-ba1f-46e6-9f4e-95a6fd66d434 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:56.449983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f80d3f93-ba1f-46e6-9f4e-95a6fd66d434 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:56.450878 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f80d3f93-ba1f-46e6-9f4e-95a6fd66d434 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:56.451404 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f80d3f93-ba1f-46e6-9f4e-95a6fd66d434 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:56.471170 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:56.480128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:56.482223 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:56.482842 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-097892c6-8f87-4cd9-a0d3-2763709616c1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.245636 Dec 13 16:53:56.483599 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 361/720] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:56 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:56.534407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f80d3f93-ba1f-46e6-9f4e-95a6fd66d434 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 38166 microversion: 2.1 time: 0.102248 Dec 13 16:53:56.535367 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 360/721] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:56 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 38166 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:57.450357 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bf8842cf-b27f-462d-ae6a-68cacb825501 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:57.451075 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bf8842cf-b27f-462d-ae6a-68cacb825501 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:57.458637 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bf8842cf-b27f-462d-ae6a-68cacb825501 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:57.459388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bf8842cf-b27f-462d-ae6a-68cacb825501 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:57.460195 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bf8842cf-b27f-462d-ae6a-68cacb825501 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:57.460834 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bf8842cf-b27f-462d-ae6a-68cacb825501 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:57.519473 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:57.524818 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:57.533788 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:57.534438 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:57.535265 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:57.535676 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:57.662607 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bf8842cf-b27f-462d-ae6a-68cacb825501 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:57.673395 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bf8842cf-b27f-462d-ae6a-68cacb825501 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.227400 Dec 13 16:53:57.679004 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 362/722] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:57 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:57.686675 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-00491249-865c-4387-b396-e982217698c7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:57.689996 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-00491249-865c-4387-b396-e982217698c7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:57.698735 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00491249-865c-4387-b396-e982217698c7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:57.699188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00491249-865c-4387-b396-e982217698c7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:57.699998 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00491249-865c-4387-b396-e982217698c7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:57.700431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00491249-865c-4387-b396-e982217698c7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:57.723293 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:57.732795 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:57.736246 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:57.737537 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ee31ee2e-6eb8-4330-8493-37a4142de276 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.228280 Dec 13 16:53:57.738535 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 361/723] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:57 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:57.792483 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-00491249-865c-4387-b396-e982217698c7 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action" status: 200 len: 38297 microversion: 2.1 time: 0.111881 Dec 13 16:53:57.793517 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 363/724] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:53:57 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/action => generated 38297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:53:57.802869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-17d02349-a444-4b67-9bfc-6c79dd913355 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:57.803413 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-17d02349-a444-4b67-9bfc-6c79dd913355 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:57.813690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17d02349-a444-4b67-9bfc-6c79dd913355 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:57.813690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17d02349-a444-4b67-9bfc-6c79dd913355 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:57.813690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17d02349-a444-4b67-9bfc-6c79dd913355 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:57.813690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-17d02349-a444-4b67-9bfc-6c79dd913355 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:57.840668 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-17d02349-a444-4b67-9bfc-6c79dd913355 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/ips" status: 200 len: 145 microversion: 2.1 time: 0.041400 Dec 13 16:53:57.844618 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 362/725] 10.222.0.62 () {58 vars in 1247 bytes} [Mon Dec 13 16:53:57 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:53:58.692021 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-00a728b6-8c84-4a97-9b7e-8c6d52110a0f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:58.692734 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-00a728b6-8c84-4a97-9b7e-8c6d52110a0f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:58.700254 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00a728b6-8c84-4a97-9b7e-8c6d52110a0f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:58.700715 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00a728b6-8c84-4a97-9b7e-8c6d52110a0f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:58.701486 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00a728b6-8c84-4a97-9b7e-8c6d52110a0f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:58.701905 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00a728b6-8c84-4a97-9b7e-8c6d52110a0f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:58.756637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:58.758189 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:58.764865 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:58.765310 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:58.766102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:58.766510 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:58.860182 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-00a728b6-8c84-4a97-9b7e-8c6d52110a0f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:58.875805 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-00a728b6-8c84-4a97-9b7e-8c6d52110a0f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.187762 Dec 13 16:53:58.877035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 364/726] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:58 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:53:58.969722 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:58.979869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:58.981696 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:53:58.983065 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9fa38b40-2eb3-4614-bf74-9c58386e9f12 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1740 microversion: 2.20 time: 0.230166 Dec 13 16:53:58.984033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 363/727] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:58 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:53:59.265678 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-cceedc54-26e9-4425-a2b0-b5234f7c34f6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "796c7f36-6ba6-4b20-a69f-90c07efed3fc"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:53:59.267248 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-cceedc54-26e9-4425-a2b0-b5234f7c34f6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:59.277820 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cceedc54-26e9-4425-a2b0-b5234f7c34f6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:59.277820 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cceedc54-26e9-4425-a2b0-b5234f7c34f6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:59.278779 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cceedc54-26e9-4425-a2b0-b5234f7c34f6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:59.279213 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cceedc54-26e9-4425-a2b0-b5234f7c34f6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:59.555382 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-cceedc54-26e9-4425-a2b0-b5234f7c34f6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295162 Dec 13 16:53:59.556084 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 365/728] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:53:59 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:53:59.896853 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7107db4e-6f57-4d1b-af75-29f22d0333b4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:53:59.897478 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7107db4e-6f57-4d1b-af75-29f22d0333b4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:53:59.905722 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7107db4e-6f57-4d1b-af75-29f22d0333b4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:59.906563 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7107db4e-6f57-4d1b-af75-29f22d0333b4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:53:59.907360 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7107db4e-6f57-4d1b-af75-29f22d0333b4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:53:59.907838 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7107db4e-6f57-4d1b-af75-29f22d0333b4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:00.004175 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:00.004883 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:00.012616 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:00.013068 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:00.013879 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:00.014298 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:00.077271 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7107db4e-6f57-4d1b-af75-29f22d0333b4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:00.085688 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7107db4e-6f57-4d1b-af75-29f22d0333b4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.194017 Dec 13 16:54:00.086677 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 364/729] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:53:59 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:54:00.162399 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:00.171002 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:00.172545 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:00.173691 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-440c6ce3-9e0c-47a5-835b-d6d13f48b89c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1722 microversion: 2.20 time: 0.174259 Dec 13 16:54:00.174275 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 366/730] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:53:59 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:54:00.589499 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-b03f0d36-b2ac-4bb0-9341-786781fd82c0 req-2e1f384c-3dca-4eda-852e-fb45ad09e2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895f7640-e4b3-4cb0-9632-d99cef54dab6", "name": "network-vif-plugged", "status": "completed", "tag": "7bfe5c97-83ad-4a06-b866-31455cbfdf29"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:00.591061 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:54:00.591061 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:54:00.598166 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b03f0d36-b2ac-4bb0-9341-786781fd82c0 req-2e1f384c-3dca-4eda-852e-fb45ad09e2fb service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:00.598676 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b03f0d36-b2ac-4bb0-9341-786781fd82c0 req-2e1f384c-3dca-4eda-852e-fb45ad09e2fb service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:00.612032 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-b03f0d36-b2ac-4bb0-9341-786781fd82c0 req-2e1f384c-3dca-4eda-852e-fb45ad09e2fb service nova] Creating event network-vif-plugged:7bfe5c97-83ad-4a06-b866-31455cbfdf29 for instance 895f7640-e4b3-4cb0-9632-d99cef54dab6 on hv-cinder-82160 Dec 13 16:54:00.617483 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-b03f0d36-b2ac-4bb0-9341-786781fd82c0 req-2e1f384c-3dca-4eda-852e-fb45ad09e2fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092705 Dec 13 16:54:00.619750 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 365/731] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:54:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:01.104251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0b25407f-2a13-461b-aad3-d5365be67c65 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:01.105061 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0b25407f-2a13-461b-aad3-d5365be67c65 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:01.112447 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0b25407f-2a13-461b-aad3-d5365be67c65 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:01.112919 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0b25407f-2a13-461b-aad3-d5365be67c65 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:01.114026 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0b25407f-2a13-461b-aad3-d5365be67c65 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:01.114454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0b25407f-2a13-461b-aad3-d5365be67c65 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:01.194185 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:01.195085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:01.205787 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:01.207756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:01.207756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:01.207756 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:01.300840 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0b25407f-2a13-461b-aad3-d5365be67c65 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:01.310786 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0b25407f-2a13-461b-aad3-d5365be67c65 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1259 microversion: 2.1 time: 0.210907 Dec 13 16:54:01.311402 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 367/732] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:01 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:01.368517 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:01.377033 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:01.378500 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:01.379634 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-21d21116-64c2-4049-9acf-f6fa664f7195 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1722 microversion: 2.20 time: 0.190183 Dec 13 16:54:01.380198 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 366/733] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:01 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:54:02.330200 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5cc389b5-c24b-4286-81b8-c32b2cccae38 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:02.330842 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5cc389b5-c24b-4286-81b8-c32b2cccae38 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:02.337784 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5cc389b5-c24b-4286-81b8-c32b2cccae38 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.338221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5cc389b5-c24b-4286-81b8-c32b2cccae38 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.339006 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5cc389b5-c24b-4286-81b8-c32b2cccae38 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.339425 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5cc389b5-c24b-4286-81b8-c32b2cccae38 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.401655 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:02.402294 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:02.409237 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.409685 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.410508 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.411185 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.498390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-5cc389b5-c24b-4286-81b8-c32b2cccae38 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:02.506753 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5cc389b5-c24b-4286-81b8-c32b2cccae38 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1441 microversion: 2.1 time: 0.180219 Dec 13 16:54:02.507329 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 368/734] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:02 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1441 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:02.523320 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d232393e-c445-4c0e-911c-20d2cd5f9783 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:02.524224 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d232393e-c445-4c0e-911c-20d2cd5f9783 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:02.530683 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d232393e-c445-4c0e-911c-20d2cd5f9783 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.531120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d232393e-c445-4c0e-911c-20d2cd5f9783 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.532102 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d232393e-c445-4c0e-911c-20d2cd5f9783 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.532747 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d232393e-c445-4c0e-911c-20d2cd5f9783 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.563485 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:02.572548 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:02.574121 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:02.575395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2e0a92a5-e4e4-41ab-95c6-3ba0b5a2246c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1665 microversion: 2.20 time: 0.178558 Dec 13 16:54:02.575880 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 367/735] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:02 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:02.595142 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-36b27db2-3683-4f80-b03b-c587ba273265 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f799092-5757-4e51-b134-05d0d5c33438"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:02.596192 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-36b27db2-3683-4f80-b03b-c587ba273265 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:02.604775 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-36b27db2-3683-4f80-b03b-c587ba273265 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.605233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-36b27db2-3683-4f80-b03b-c587ba273265 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.606022 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-36b27db2-3683-4f80-b03b-c587ba273265 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.606455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-36b27db2-3683-4f80-b03b-c587ba273265 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.686762 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d232393e-c445-4c0e-911c-20d2cd5f9783 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:02.694928 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d232393e-c445-4c0e-911c-20d2cd5f9783 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1441 microversion: 2.1 time: 0.175403 Dec 13 16:54:02.706241 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 369/736] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:02 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1441 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:02.706241 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-99abd6d6-fca3-4d19-8ee5-1610688426d1 req-ba584204-cded-4f06-8ca5-dadf1d4868b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea34650-4715-472f-a562-e8929cb0f319", "name": "network-vif-unplugged", "status": "completed", "tag": "823c9158-6eee-4748-8e22-293145c6db04"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:02.706241 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:54:02.706241 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:54:02.712129 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-99abd6d6-fca3-4d19-8ee5-1610688426d1 req-ba584204-cded-4f06-8ca5-dadf1d4868b8 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:02.712900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-99abd6d6-fca3-4d19-8ee5-1610688426d1 req-ba584204-cded-4f06-8ca5-dadf1d4868b8 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:02.729180 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.compute.server_external_events [req-99abd6d6-fca3-4d19-8ee5-1610688426d1 req-ba584204-cded-4f06-8ca5-dadf1d4868b8 service nova] Unable to find a host for instance 3ea34650-4715-472f-a562-e8929cb0f319. Dropping event network-vif-unplugged {{(pid=122886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 13 16:54:02.730104 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-99abd6d6-fca3-4d19-8ee5-1610688426d1 req-ba584204-cded-4f06-8ca5-dadf1d4868b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033345 Dec 13 16:54:02.733718 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 370/737] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:54:02 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 13 16:54:02.900220 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-36b27db2-3683-4f80-b03b-c587ba273265 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309085 Dec 13 16:54:02.900991 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 368/738] 10.222.0.62 () {62 vars in 1363 bytes} [Mon Dec 13 16:54:02 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 13 16:54:03.014282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4d3e53ca-50bb-47d8-bbfc-7e94b02d778e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:03.014910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4d3e53ca-50bb-47d8-bbfc-7e94b02d778e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:03.020938 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d3e53ca-50bb-47d8-bbfc-7e94b02d778e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:03.021384 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d3e53ca-50bb-47d8-bbfc-7e94b02d778e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:03.022155 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d3e53ca-50bb-47d8-bbfc-7e94b02d778e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:03.022581 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d3e53ca-50bb-47d8-bbfc-7e94b02d778e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:03.287791 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4d3e53ca-50bb-47d8-bbfc-7e94b02d778e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/os-volume_attachments/4f799092-5757-4e51-b134-05d0d5c33438" status: 202 len: 0 microversion: 2.20 time: 0.277619 Dec 13 16:54:03.288812 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 371/739] 10.222.0.62 () {60 vars in 1456 bytes} [Mon Dec 13 16:54:03 2021] DELETE /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/os-volume_attachments/4f799092-5757-4e51-b134-05d0d5c33438 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:54:03.345392 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-82117466-5c76-4179-946c-8b4794db632f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:03.345831 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-82117466-5c76-4179-946c-8b4794db632f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:03.351939 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82117466-5c76-4179-946c-8b4794db632f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:03.352379 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82117466-5c76-4179-946c-8b4794db632f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:03.353308 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82117466-5c76-4179-946c-8b4794db632f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:03.353738 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82117466-5c76-4179-946c-8b4794db632f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:03.458206 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-82117466-5c76-4179-946c-8b4794db632f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action" status: 202 len: 0 microversion: 2.20 time: 0.116660 Dec 13 16:54:03.459529 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 369/740] 10.222.0.62 () {62 vars in 1318 bytes} [Mon Dec 13 16:54:03 2021] POST /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:54:03.467922 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:03.469259 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:03.479122 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:03.479877 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:03.480946 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:03.481569 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:03.734721 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:03.751752 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:03.754015 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:03.755245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6fccade1-809b-4d97-b5f6-d0714996482f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1673 microversion: 2.20 time: 0.291217 Dec 13 16:54:03.766657 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 372/741] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:03 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1673 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:04.679164 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-c208202a-14d3-4d06-b226-1e29bfb614f9 req-eaa389e8-f735-4c87-9a9b-80fc4d79fcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895f7640-e4b3-4cb0-9632-d99cef54dab6", "tag": "7bfe5c97-83ad-4a06-b866-31455cbfdf29"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:04.681584 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:54:04.681584 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:54:04.689740 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-c208202a-14d3-4d06-b226-1e29bfb614f9 req-eaa389e8-f735-4c87-9a9b-80fc4d79fcd7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:04.690187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-c208202a-14d3-4d06-b226-1e29bfb614f9 req-eaa389e8-f735-4c87-9a9b-80fc4d79fcd7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:04.701274 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-c208202a-14d3-4d06-b226-1e29bfb614f9 req-eaa389e8-f735-4c87-9a9b-80fc4d79fcd7 service nova] Creating event network-changed:7bfe5c97-83ad-4a06-b866-31455cbfdf29 for instance 895f7640-e4b3-4cb0-9632-d99cef54dab6 on hv-cinder-82160 Dec 13 16:54:04.706174 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-c208202a-14d3-4d06-b226-1e29bfb614f9 req-eaa389e8-f735-4c87-9a9b-80fc4d79fcd7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097164 Dec 13 16:54:04.707026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 370/742] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:54:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:04.774103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:04.775035 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:04.782905 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:04.783484 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:04.784362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:04.784911 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:05.287642 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:05.296897 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:05.298798 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:05.300231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ffcdf877-13e9-40fc-88c8-8f3afaaaa56e tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.529882 Dec 13 16:54:05.301371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 373/743] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:04 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:06.052168 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-82f14516-37b8-4f8d-9756-fd629e355853 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:06.053294 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-82f14516-37b8-4f8d-9756-fd629e355853 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:06.060855 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82f14516-37b8-4f8d-9756-fd629e355853 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:06.061392 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82f14516-37b8-4f8d-9756-fd629e355853 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:06.062252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82f14516-37b8-4f8d-9756-fd629e355853 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:06.062667 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-82f14516-37b8-4f8d-9756-fd629e355853 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:06.094475 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-82f14516-37b8-4f8d-9756-fd629e355853 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046933 Dec 13 16:54:06.095046 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 371/744] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:54:06 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:06.105728 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-500803ea-6fa5-4a6f-a759-7c4c8a220f19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:06.107107 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-500803ea-6fa5-4a6f-a759-7c4c8a220f19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:06.114574 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-500803ea-6fa5-4a6f-a759-7c4c8a220f19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:06.115383 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-500803ea-6fa5-4a6f-a759-7c4c8a220f19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:06.116344 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-500803ea-6fa5-4a6f-a759-7c4c8a220f19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:06.116956 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-500803ea-6fa5-4a6f-a759-7c4c8a220f19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:06.151302 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-500803ea-6fa5-4a6f-a759-7c4c8a220f19 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/796c7f36-6ba6-4b20-a69f-90c07efed3fc" status: 200 len: 194 microversion: 2.1 time: 0.049942 Dec 13 16:54:06.169381 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 374/745] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Dec 13 16:54:06 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/796c7f36-6ba6-4b20-a69f-90c07efed3fc => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:54:06.320649 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:06.324704 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:06.335494 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:06.347745 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:06.348678 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:06.349321 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:06.549350 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:06.570273 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:06.572521 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:06.574225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c5448fac-30c1-413b-b24c-0673bd431461 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.258355 Dec 13 16:54:06.574986 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 372/746] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:06 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:07.592493 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:07.593116 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:07.599749 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:07.600058 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:07.601001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:07.601463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:07.616272 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-35f3928f-dec0-4f8f-9ddf-ee9d81ea1f9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8af522cb-53b3-4154-8932-ba5c7e03d35b"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:07.617471 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-35f3928f-dec0-4f8f-9ddf-ee9d81ea1f9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:07.624396 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-35f3928f-dec0-4f8f-9ddf-ee9d81ea1f9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:07.625098 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-35f3928f-dec0-4f8f-9ddf-ee9d81ea1f9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:07.626050 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-35f3928f-dec0-4f8f-9ddf-ee9d81ea1f9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:07.626717 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-35f3928f-dec0-4f8f-9ddf-ee9d81ea1f9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:07.769398 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:07.778493 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:07.780245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:07.781986 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b6342496-a921-4e66-9525-e0c0e1983b40 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.193153 Dec 13 16:54:07.782546 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 375/747] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:07 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:08.800505 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:08.801239 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:08.809182 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:08.810000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:08.811128 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:08.811763 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:08.961186 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:08.970430 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:08.971946 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:08.973156 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-231cb1c3-1258-4fa9-87e6-011731409a7f tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.176599 Dec 13 16:54:08.980613 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 376/748] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:08 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:09.991669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:09.992410 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:09.999655 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:10.000282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:10.001187 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:10.002198 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:10.144602 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:10.153262 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:10.154758 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:10.155922 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ed17fab2-ff5d-4154-80b3-b2964a8185f5 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.168134 Dec 13 16:54:10.160550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 377/749] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:09 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:11.177896 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:11.178578 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:11.184979 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:11.185427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:11.186232 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:11.186644 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:11.344082 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:11.353571 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:11.355101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:11.356466 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-863781bc-1564-43a1-96fb-bd8b00cb5bb6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.183519 Dec 13 16:54:11.357058 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 378/750] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:11 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:12.377662 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:12.379051 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:12.385694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:12.386138 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:12.386916 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:12.387549 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:12.536989 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:12.545360 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:12.546790 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:12.548626 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d81e1dd0-7be0-4b81-9b3a-871cffcd2ee4 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.174772 Dec 13 16:54:12.549529 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 379/751] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:12 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:13.568040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:13.569018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:13.576944 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:13.577394 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:13.578189 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:13.578614 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:13.725480 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:13.734517 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:13.736346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:13.737532 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e7ae2f3b-0dcc-4d52-a807-9b6cc75f82f6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.174043 Dec 13 16:54:13.738089 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 380/752] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:13 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:14.762522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:14.763235 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:14.775536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:14.775536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:14.775536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:14.775536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:14.919493 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:14.931709 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:14.933282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:14.934447 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ff391e49-62fb-4789-aeb6-f4718dac2da8 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.182366 Dec 13 16:54:14.935049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 381/753] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:14 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:54:15.956111 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:15.956938 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:15.964485 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:15.964961 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:15.965744 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:15.966169 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:16.109393 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:16.118123 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:16.119615 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:16.120809 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-fbffa082-875e-4225-a465-eebac8cb9d5c tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.170440 Dec 13 16:54:16.121370 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 382/754] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:15 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:54:16.792193 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-35f3928f-dec0-4f8f-9ddf-ee9d81ea1f9b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.179239 Dec 13 16:54:16.793063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 373/755] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:54:07 2021] POST /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments => generated 194 bytes in 9181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:17.141203 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:17.141839 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:17.150249 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:17.150744 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:17.151741 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:17.152218 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:17.307431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:17.315802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:17.317355 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:17.318491 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5bd9a112-da53-4531-a610-00da5d6c8203 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.182746 Dec 13 16:54:17.319299 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 383/756] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:17 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:18.340454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:18.341249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:18.348398 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:18.349153 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:18.349931 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:18.350332 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:18.500548 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:18.508358 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:18.509993 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:18.511197 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3bf08fba-86be-46e7-9015-976a7110ffca tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.176534 Dec 13 16:54:18.511774 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 374/757] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:18 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:19.530868 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:19.531460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:19.538269 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:19.538718 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:19.539494 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:19.539924 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:19.692855 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:19.701811 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:19.703296 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:19.704473 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a2101457-5182-46c5-9cf8-a18c5f98db3d tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.177574 Dec 13 16:54:19.705095 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 384/758] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:19 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:20.605643 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-b7e40550-2372-447b-b293-12a149009b95 req-78076267-b212-4d48-adc9-eb6ee8069d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea34650-4715-472f-a562-e8929cb0f319", "name": "network-vif-plugged", "status": "completed", "tag": "823c9158-6eee-4748-8e22-293145c6db04"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:20.607445 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:54:20.607445 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:54:20.619320 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b7e40550-2372-447b-b293-12a149009b95 req-78076267-b212-4d48-adc9-eb6ee8069d03 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:20.621314 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b7e40550-2372-447b-b293-12a149009b95 req-78076267-b212-4d48-adc9-eb6ee8069d03 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:20.641163 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-b7e40550-2372-447b-b293-12a149009b95 req-78076267-b212-4d48-adc9-eb6ee8069d03 service nova] Creating event network-vif-plugged:823c9158-6eee-4748-8e22-293145c6db04 for instance 3ea34650-4715-472f-a562-e8929cb0f319 on hv-cinder-82160 Dec 13 16:54:20.650012 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-b7e40550-2372-447b-b293-12a149009b95 req-78076267-b212-4d48-adc9-eb6ee8069d03 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049301 Dec 13 16:54:20.651676 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 375/759] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:54:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:20.722934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:20.723539 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:20.730727 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:20.731570 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:20.732612 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:20.733252 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:20.968119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:20.976841 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:20.978321 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:20.979577 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0d5124e9-bcb3-4295-a2a8-ae562c7c6454 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.260382 Dec 13 16:54:20.980122 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 385/760] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:20 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:21.998512 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:21.999187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:22.006175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:22.006561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:22.007325 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:22.007735 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:22.160497 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:22.169960 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:22.171471 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:22.172647 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a826eee1-a542-4603-8571-9869addb91ed tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1731 microversion: 2.20 time: 0.178519 Dec 13 16:54:22.173301 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 376/761] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:21 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:23.191193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:23.191801 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:23.200374 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:23.200856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:23.201674 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:23.202101 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:23.360557 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:23.368487 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:23.370709 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:23.371880 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3a89e6d6-70cf-44f1-a6f1-fe069a095114 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1718 microversion: 2.20 time: 0.184366 Dec 13 16:54:23.372659 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 386/762] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:23 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1718 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:24.318037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-93e8c43a-de71-4546-8846-43fa0a4a425a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:24.319042 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-93e8c43a-de71-4546-8846-43fa0a4a425a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:24.326109 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-93e8c43a-de71-4546-8846-43fa0a4a425a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:24.326559 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-93e8c43a-de71-4546-8846-43fa0a4a425a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:24.327350 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-93e8c43a-de71-4546-8846-43fa0a4a425a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:24.327779 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-93e8c43a-de71-4546-8846-43fa0a4a425a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:24.361241 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-93e8c43a-de71-4546-8846-43fa0a4a425a tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047025 Dec 13 16:54:24.361795 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 377/763] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:54:24 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:24.637597 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9b69c549-668d-4dca-9306-06773a9509e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:24.638159 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9b69c549-668d-4dca-9306-06773a9509e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:24.645233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9b69c549-668d-4dca-9306-06773a9509e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:24.645676 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9b69c549-668d-4dca-9306-06773a9509e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:24.646461 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9b69c549-668d-4dca-9306-06773a9509e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:24.646912 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9b69c549-668d-4dca-9306-06773a9509e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:24.678102 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9b69c549-668d-4dca-9306-06773a9509e0 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/796c7f36-6ba6-4b20-a69f-90c07efed3fc" status: 200 len: 194 microversion: 2.1 time: 0.047530 Dec 13 16:54:24.678702 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 387/764] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Dec 13 16:54:24 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/796c7f36-6ba6-4b20-a69f-90c07efed3fc => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:24.690568 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1efe67f0-4fe3-4248-8b8c-041a3231bc9d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:24.691220 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1efe67f0-4fe3-4248-8b8c-041a3231bc9d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:24.700156 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1efe67f0-4fe3-4248-8b8c-041a3231bc9d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:24.700593 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1efe67f0-4fe3-4248-8b8c-041a3231bc9d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:24.701398 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1efe67f0-4fe3-4248-8b8c-041a3231bc9d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:24.701814 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1efe67f0-4fe3-4248-8b8c-041a3231bc9d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:24.781444 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-1efe67f0-4fe3-4248-8b8c-041a3231bc9d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lazy-loading 'services' on Instance uuid 69060b24-b5af-457d-9dc6-6999ce84c7bc {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:54:24.862939 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1efe67f0-4fe3-4248-8b8c-041a3231bc9d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/796c7f36-6ba6-4b20-a69f-90c07efed3fc" status: 202 len: 0 microversion: 2.1 time: 0.177832 Dec 13 16:54:24.863604 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 378/765] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:54:24 2021] DELETE /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/796c7f36-6ba6-4b20-a69f-90c07efed3fc => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:54:25.980508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3ed494e8-7bc5-4ba6-9690-66258138702d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:25.981079 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3ed494e8-7bc5-4ba6-9690-66258138702d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:25.988455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3ed494e8-7bc5-4ba6-9690-66258138702d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:25.988926 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3ed494e8-7bc5-4ba6-9690-66258138702d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:25.989765 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3ed494e8-7bc5-4ba6-9690-66258138702d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:25.990191 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3ed494e8-7bc5-4ba6-9690-66258138702d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:26.019645 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3ed494e8-7bc5-4ba6-9690-66258138702d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/8af522cb-53b3-4154-8932-ba5c7e03d35b" status: 200 len: 194 microversion: 2.1 time: 0.042929 Dec 13 16:54:26.020225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 388/766] 10.222.0.62 () {58 vars in 1412 bytes} [Mon Dec 13 16:54:25 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/8af522cb-53b3-4154-8932-ba5c7e03d35b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:26.037470 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-55352cfd-0808-44e3-9d49-492c96fbc4f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:26.038081 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-55352cfd-0808-44e3-9d49-492c96fbc4f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:26.047347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-55352cfd-0808-44e3-9d49-492c96fbc4f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:26.047792 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-55352cfd-0808-44e3-9d49-492c96fbc4f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:26.048596 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-55352cfd-0808-44e3-9d49-492c96fbc4f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:26.049028 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-55352cfd-0808-44e3-9d49-492c96fbc4f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:26.140602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-55352cfd-0808-44e3-9d49-492c96fbc4f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lazy-loading 'services' on Instance uuid 69060b24-b5af-457d-9dc6-6999ce84c7bc {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:54:26.215142 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-55352cfd-0808-44e3-9d49-492c96fbc4f1 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/8af522cb-53b3-4154-8932-ba5c7e03d35b" status: 202 len: 0 microversion: 2.1 time: 0.186211 Dec 13 16:54:26.215716 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 379/767] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:54:26 2021] DELETE /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments/8af522cb-53b3-4154-8932-ba5c7e03d35b => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:54:27.376561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-db20c9fe-29ad-44d6-bce7-f6c28123fcee tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:27.377597 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-db20c9fe-29ad-44d6-bce7-f6c28123fcee tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:27.384599 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-db20c9fe-29ad-44d6-bce7-f6c28123fcee tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:27.385065 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-db20c9fe-29ad-44d6-bce7-f6c28123fcee tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:27.385845 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-db20c9fe-29ad-44d6-bce7-f6c28123fcee tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:27.386277 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-db20c9fe-29ad-44d6-bce7-f6c28123fcee tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:27.417790 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-db20c9fe-29ad-44d6-bce7-f6c28123fcee tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046839 Dec 13 16:54:27.418347 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 389/768] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:54:27 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:54:27.535768 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6f781541-87b2-44e5-a2c5-2a7b0c7cfcb6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:27.536848 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6f781541-87b2-44e5-a2c5-2a7b0c7cfcb6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:27.543533 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6f781541-87b2-44e5-a2c5-2a7b0c7cfcb6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:27.543985 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6f781541-87b2-44e5-a2c5-2a7b0c7cfcb6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:27.544801 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6f781541-87b2-44e5-a2c5-2a7b0c7cfcb6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:27.545235 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6f781541-87b2-44e5-a2c5-2a7b0c7cfcb6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:27.576988 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6f781541-87b2-44e5-a2c5-2a7b0c7cfcb6 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045732 Dec 13 16:54:27.577678 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 380/769] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:54:27 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:54:27.639651 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-542f3602-780b-495c-b02a-c08b2d09d33d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:27.640283 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-542f3602-780b-495c-b02a-c08b2d09d33d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:27.647355 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-542f3602-780b-495c-b02a-c08b2d09d33d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:27.647793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-542f3602-780b-495c-b02a-c08b2d09d33d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:27.648561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-542f3602-780b-495c-b02a-c08b2d09d33d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:27.649046 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-542f3602-780b-495c-b02a-c08b2d09d33d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:27.673654 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-542f3602-780b-495c-b02a-c08b2d09d33d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:54:27.764603 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-542f3602-780b-495c-b02a-c08b2d09d33d tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 204 len: 0 microversion: 2.1 time: 0.130488 Dec 13 16:54:27.765486 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 390/770] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:54:27 2021] DELETE /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:54:27.777583 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5b95abbe-9354-4233-8d48-6f01bb3e2212 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:27.778352 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5b95abbe-9354-4233-8d48-6f01bb3e2212 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:27.785363 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b95abbe-9354-4233-8d48-6f01bb3e2212 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:27.785808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b95abbe-9354-4233-8d48-6f01bb3e2212 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:27.786585 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b95abbe-9354-4233-8d48-6f01bb3e2212 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:27.787012 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5b95abbe-9354-4233-8d48-6f01bb3e2212 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:27.928935 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5b95abbe-9354-4233-8d48-6f01bb3e2212 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:27.939121 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5b95abbe-9354-4233-8d48-6f01bb3e2212 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1673 microversion: 2.1 time: 0.167967 Dec 13 16:54:27.939695 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 381/771] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:27 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:28.965633 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-195ba1d0-16f7-46aa-a923-7697ef1a24b3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:28.966784 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-195ba1d0-16f7-46aa-a923-7697ef1a24b3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:28.978326 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-195ba1d0-16f7-46aa-a923-7697ef1a24b3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:28.979068 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-195ba1d0-16f7-46aa-a923-7697ef1a24b3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:28.980350 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-195ba1d0-16f7-46aa-a923-7697ef1a24b3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:28.981100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-195ba1d0-16f7-46aa-a923-7697ef1a24b3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:29.152379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-195ba1d0-16f7-46aa-a923-7697ef1a24b3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:29.164225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-195ba1d0-16f7-46aa-a923-7697ef1a24b3 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1673 microversion: 2.1 time: 0.205409 Dec 13 16:54:29.165134 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 391/772] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:28 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1673 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:30.182893 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6413b82e-c421-4875-a18d-25bccf6d434b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:30.183469 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6413b82e-c421-4875-a18d-25bccf6d434b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:30.190298 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6413b82e-c421-4875-a18d-25bccf6d434b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:30.190737 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6413b82e-c421-4875-a18d-25bccf6d434b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:30.191510 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6413b82e-c421-4875-a18d-25bccf6d434b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:30.191939 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6413b82e-c421-4875-a18d-25bccf6d434b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:30.324716 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6413b82e-c421-4875-a18d-25bccf6d434b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c282fd140f5645ca89c2e64888ea1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'febd1024088a4a22984d59922da28de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:30.342217 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6413b82e-c421-4875-a18d-25bccf6d434b tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 200 len: 1673 microversion: 2.1 time: 0.162992 Dec 13 16:54:30.342807 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 382/773] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:30 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:30.641484 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-83790cb7-714b-4081-b78d-617d75f68f75 req-656ee406-c53b-4082-888c-4178e8121ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69060b24-b5af-457d-9dc6-6999ce84c7bc", "name": "network-vif-deleted", "tag": "45133903-44dc-4175-8074-bd78bf1235a8"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:30.643441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:54:30.643441 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:54:30.658004 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-83790cb7-714b-4081-b78d-617d75f68f75 req-656ee406-c53b-4082-888c-4178e8121ae6 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:30.658483 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-83790cb7-714b-4081-b78d-617d75f68f75 req-656ee406-c53b-4082-888c-4178e8121ae6 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:30.673049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-83790cb7-714b-4081-b78d-617d75f68f75 req-656ee406-c53b-4082-888c-4178e8121ae6 service nova] Creating event network-vif-deleted:45133903-44dc-4175-8074-bd78bf1235a8 for instance 69060b24-b5af-457d-9dc6-6999ce84c7bc on hv-cinder-82160 Dec 13 16:54:30.679217 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-83790cb7-714b-4081-b78d-617d75f68f75 req-656ee406-c53b-4082-888c-4178e8121ae6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042519 Dec 13 16:54:30.683598 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 392/774] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:54:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:31.360621 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:31.361214 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:31.368128 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:31.368557 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:31.369380 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:31.369799 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:31.384476 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] HTTP exception thrown: Instance 69060b24-b5af-457d-9dc6-6999ce84c7bc could not be found. Dec 13 16:54:31.385101 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Returning 404 to user: Instance 69060b24-b5af-457d-9dc6-6999ce84c7bc could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:54:31.385899 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-29ea70c5-4d6a-4ea6-92b0-151baf1fa898 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 404 len: 111 microversion: 2.1 time: 0.029719 Dec 13 16:54:31.386473 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 383/775] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:31 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:54:31.396945 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5e0dc87a-1bb7-4294-a539-05719242cf9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '.version_select at 0x7f213bf463a0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:31.418288 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5e0dc87a-1bb7-4294-a539-05719242cf9e tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131611037" status: 202 len: 0 microversion: 2.1 time: 0.025530 Dec 13 16:54:31.418864 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 393/776] 10.222.0.62 () {58 vars in 1220 bytes} [Mon Dec 13 16:54:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131611037 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:54:34.348454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:34.349013 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:34.355727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:34.356173 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:34.356969 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:34.357392 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:34.372587 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] HTTP exception thrown: Instance 69060b24-b5af-457d-9dc6-6999ce84c7bc could not be found. Dec 13 16:54:34.373173 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Returning 404 to user: Instance 69060b24-b5af-457d-9dc6-6999ce84c7bc could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:54:34.373974 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3ccfa6e8-8b57-44fa-8075-1bb1d90472e5 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 404 len: 111 microversion: 2.1 time: 0.029248 Dec 13 16:54:34.374501 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 384/777] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:54:34 2021] DELETE /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:54:34.382713 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:34.383448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 69060b24-b5af-457d-9dc6-6999ce84c7bc] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:34.390766 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:34.391213 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:34.391993 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:34.392427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:34.406746 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] HTTP exception thrown: Instance 69060b24-b5af-457d-9dc6-6999ce84c7bc could not be found. Dec 13 16:54:34.407334 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Returning 404 to user: Instance 69060b24-b5af-457d-9dc6-6999ce84c7bc could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:54:34.408159 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bd9705d5-8439-487e-85be-b8501529d5a2 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc" status: 404 len: 111 microversion: 2.1 time: 0.029153 Dec 13 16:54:34.409031 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 394/778] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:34 2021] GET /compute/v2.1/servers/69060b24-b5af-457d-9dc6-6999ce84c7bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:54:35.563850 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:35.564473 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:35.574183 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:35.574625 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:35.575409 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:35.575839 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:35.591289 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] HTTP exception thrown: Instance 1f2466eb-448e-4984-bf58-746c53cddaac could not be found. Dec 13 16:54:35.591879 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Returning 404 to user: Instance 1f2466eb-448e-4984-bf58-746c53cddaac could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:54:35.592727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7a8271f4-cc85-49c6-aee8-89089c0f0b92 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 404 len: 111 microversion: 2.1 time: 0.032718 Dec 13 16:54:35.593284 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 385/779] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:54:35 2021] DELETE /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:54:35.601824 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:35.602423 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] [instance: 1f2466eb-448e-4984-bf58-746c53cddaac] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:35.609805 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:35.610243 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:35.611013 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:35.611469 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:35.627426 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] HTTP exception thrown: Instance 1f2466eb-448e-4984-bf58-746c53cddaac could not be found. Dec 13 16:54:35.628008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] Returning 404 to user: Instance 1f2466eb-448e-4984-bf58-746c53cddaac could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:54:35.629096 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4d2a80e3-a703-43dc-a0d8-9f7378edb531 tempest-AttachVolumeTestJSON-2135202432 tempest-AttachVolumeTestJSON-2135202432-project] 10.222.0.62 "GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac" status: 404 len: 111 microversion: 2.1 time: 0.030733 Dec 13 16:54:35.629669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 395/780] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:35 2021] GET /compute/v2.1/servers/1f2466eb-448e-4984-bf58-746c53cddaac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:54:41.614491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-146201797", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "9a74d399-a83a-4821-82c3-e489fb3f4179"}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:41.674635 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] validate_networks() for [('9a74d399-a83a-4821-82c3-e489fb3f4179', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:54:42.047982 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:54:42.048400 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:54:42.049019 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:54:42.049306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:54:42.049870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:54:42.059136 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:42.059580 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:42.060388 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:42.060857 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:42.077922 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Getting quotas for project c6d1af29ea9c44a7870cae601abfe353. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:54:42.082211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Getting quotas for user 431688bdedc6443cb3718b6af3cdcc30 and project c6d1af29ea9c44a7870cae601abfe353. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:54:42.093910 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:54:42.096490 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:54:42.153065 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a5143085-8704-4c5a-90b7-ed32be01ac4b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662521 Dec 13 16:54:42.153911 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 386/781] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:54:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:54:42.163986 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-353ebfa8-e032-4b94-b431-9f91277900a6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:42.164555 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-353ebfa8-e032-4b94-b431-9f91277900a6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:42.220247 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-353ebfa8-e032-4b94-b431-9f91277900a6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:42.227668 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-353ebfa8-e032-4b94-b431-9f91277900a6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1217 microversion: 2.1 time: 0.067464 Dec 13 16:54:42.228235 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 396/782] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:42 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:43.246245 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fb5981ac-aaf8-4528-9417-8abe2b499131 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:43.246897 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fb5981ac-aaf8-4528-9417-8abe2b499131 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:43.254504 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb5981ac-aaf8-4528-9417-8abe2b499131 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:43.255193 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb5981ac-aaf8-4528-9417-8abe2b499131 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:43.256197 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb5981ac-aaf8-4528-9417-8abe2b499131 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:43.256829 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fb5981ac-aaf8-4528-9417-8abe2b499131 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:43.323673 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fb5981ac-aaf8-4528-9417-8abe2b499131 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:43.331975 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fb5981ac-aaf8-4528-9417-8abe2b499131 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1287 microversion: 2.1 time: 0.090363 Dec 13 16:54:43.333218 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 387/783] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:43 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:44.349311 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-71e84ce1-5cc8-440c-9b90-9fb9c99624d2 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:44.349922 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-71e84ce1-5cc8-440c-9b90-9fb9c99624d2 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:44.356651 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-71e84ce1-5cc8-440c-9b90-9fb9c99624d2 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:44.357105 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-71e84ce1-5cc8-440c-9b90-9fb9c99624d2 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:44.357884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-71e84ce1-5cc8-440c-9b90-9fb9c99624d2 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:44.358311 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-71e84ce1-5cc8-440c-9b90-9fb9c99624d2 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:44.553415 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-71e84ce1-5cc8-440c-9b90-9fb9c99624d2 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:44.560945 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-71e84ce1-5cc8-440c-9b90-9fb9c99624d2 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1317 microversion: 2.1 time: 0.215439 Dec 13 16:54:44.561525 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 397/784] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:44 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:44.610996 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-6bd081af-bdad-48af-805e-6ce4d1d18864 req-ee71581c-4c3f-481e-b6da-8a88325dd735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5af783e-db46-4b24-892e-598e120cd9bf", "tag": "dc82648a-ba50-4acf-b164-725387a2d87d"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:44.612875 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:54:44.612875 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:54:44.621169 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-6bd081af-bdad-48af-805e-6ce4d1d18864 req-ee71581c-4c3f-481e-b6da-8a88325dd735 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:44.621816 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-6bd081af-bdad-48af-805e-6ce4d1d18864 req-ee71581c-4c3f-481e-b6da-8a88325dd735 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:44.634100 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-6bd081af-bdad-48af-805e-6ce4d1d18864 req-ee71581c-4c3f-481e-b6da-8a88325dd735 service nova] Creating event network-changed:dc82648a-ba50-4acf-b164-725387a2d87d for instance e5af783e-db46-4b24-892e-598e120cd9bf on hv-cinder-82160 Dec 13 16:54:44.639141 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-6bd081af-bdad-48af-805e-6ce4d1d18864 req-ee71581c-4c3f-481e-b6da-8a88325dd735 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032430 Dec 13 16:54:44.639736 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 388/785] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:54:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:45.580779 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-00b89199-cf12-470e-8df2-a4c82209d89a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:45.582103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-00b89199-cf12-470e-8df2-a4c82209d89a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:45.588899 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00b89199-cf12-470e-8df2-a4c82209d89a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:45.589342 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00b89199-cf12-470e-8df2-a4c82209d89a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:45.590114 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00b89199-cf12-470e-8df2-a4c82209d89a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:45.590508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00b89199-cf12-470e-8df2-a4c82209d89a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:45.733193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-00b89199-cf12-470e-8df2-a4c82209d89a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:45.742445 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-00b89199-cf12-470e-8df2-a4c82209d89a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1317 microversion: 2.1 time: 0.167193 Dec 13 16:54:45.743012 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 398/786] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:45 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:46.764326 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ddd1f179-6ac4-45ec-bf60-b16e1379ae91 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:46.765136 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ddd1f179-6ac4-45ec-bf60-b16e1379ae91 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:46.772088 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ddd1f179-6ac4-45ec-bf60-b16e1379ae91 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:46.772535 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ddd1f179-6ac4-45ec-bf60-b16e1379ae91 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:46.773346 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ddd1f179-6ac4-45ec-bf60-b16e1379ae91 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:46.773780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ddd1f179-6ac4-45ec-bf60-b16e1379ae91 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:46.913854 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ddd1f179-6ac4-45ec-bf60-b16e1379ae91 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:46.921939 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ddd1f179-6ac4-45ec-bf60-b16e1379ae91 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1317 microversion: 2.1 time: 0.162215 Dec 13 16:54:46.922469 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 389/787] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:46 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:47.939921 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-15471728-23ee-41e0-a3fe-44c2f6cf9c15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:47.940856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-15471728-23ee-41e0-a3fe-44c2f6cf9c15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:47.947703 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15471728-23ee-41e0-a3fe-44c2f6cf9c15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:47.948170 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15471728-23ee-41e0-a3fe-44c2f6cf9c15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:47.949032 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15471728-23ee-41e0-a3fe-44c2f6cf9c15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:47.949450 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15471728-23ee-41e0-a3fe-44c2f6cf9c15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:48.095975 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-15471728-23ee-41e0-a3fe-44c2f6cf9c15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:48.104228 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-15471728-23ee-41e0-a3fe-44c2f6cf9c15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1317 microversion: 2.1 time: 0.168710 Dec 13 16:54:48.104828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 399/788] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:47 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:48.729827 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-47c9a566-2a75-43f6-b6fc-04dd4f3556a4 req-93bb8458-1ab5-4f6e-9c52-7c191569b659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5af783e-db46-4b24-892e-598e120cd9bf", "name": "network-vif-plugged", "status": "completed", "tag": "dc82648a-ba50-4acf-b164-725387a2d87d"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:48.731345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:54:48.731345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:54:48.739571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-47c9a566-2a75-43f6-b6fc-04dd4f3556a4 req-93bb8458-1ab5-4f6e-9c52-7c191569b659 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:48.740013 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-47c9a566-2a75-43f6-b6fc-04dd4f3556a4 req-93bb8458-1ab5-4f6e-9c52-7c191569b659 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:48.751969 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-47c9a566-2a75-43f6-b6fc-04dd4f3556a4 req-93bb8458-1ab5-4f6e-9c52-7c191569b659 service nova] Creating event network-vif-plugged:dc82648a-ba50-4acf-b164-725387a2d87d for instance e5af783e-db46-4b24-892e-598e120cd9bf on hv-cinder-82160 Dec 13 16:54:48.757086 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-47c9a566-2a75-43f6-b6fc-04dd4f3556a4 req-93bb8458-1ab5-4f6e-9c52-7c191569b659 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031249 Dec 13 16:54:48.757703 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 390/789] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:54:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:49.121653 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-56b68cc7-13ed-4519-b42a-48456d2c9c7e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:49.122288 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-56b68cc7-13ed-4519-b42a-48456d2c9c7e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:49.130266 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56b68cc7-13ed-4519-b42a-48456d2c9c7e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:49.130833 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56b68cc7-13ed-4519-b42a-48456d2c9c7e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:49.131706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56b68cc7-13ed-4519-b42a-48456d2c9c7e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:49.132145 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56b68cc7-13ed-4519-b42a-48456d2c9c7e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:49.282156 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-56b68cc7-13ed-4519-b42a-48456d2c9c7e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:49.290237 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-56b68cc7-13ed-4519-b42a-48456d2c9c7e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1317 microversion: 2.1 time: 0.172350 Dec 13 16:54:49.290811 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 400/790] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:49 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:50.309395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2cd6ba3b-66dc-4e7d-ac17-02230f16629f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:50.310090 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2cd6ba3b-66dc-4e7d-ac17-02230f16629f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:50.317407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cd6ba3b-66dc-4e7d-ac17-02230f16629f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:50.317850 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cd6ba3b-66dc-4e7d-ac17-02230f16629f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:50.318634 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cd6ba3b-66dc-4e7d-ac17-02230f16629f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:50.319064 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2cd6ba3b-66dc-4e7d-ac17-02230f16629f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:50.473826 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2cd6ba3b-66dc-4e7d-ac17-02230f16629f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:50.482074 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2cd6ba3b-66dc-4e7d-ac17-02230f16629f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1507 microversion: 2.1 time: 0.177304 Dec 13 16:54:50.482646 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 391/791] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:50 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:51.877593 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-00054b1b-5eab-456d-9e54-6c4600693f05 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57052f87-9b7a-44f4-8009-646a0858adb7"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:51.878635 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-00054b1b-5eab-456d-9e54-6c4600693f05 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:51.885785 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00054b1b-5eab-456d-9e54-6c4600693f05 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:51.886233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00054b1b-5eab-456d-9e54-6c4600693f05 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:51.886996 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00054b1b-5eab-456d-9e54-6c4600693f05 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:51.887420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-00054b1b-5eab-456d-9e54-6c4600693f05 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:52.160248 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-00054b1b-5eab-456d-9e54-6c4600693f05 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286239 Dec 13 16:54:52.160880 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 401/792] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:54:51 2021] POST /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:54:56.388193 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9a0f9c7e-8d16-490f-90de-2a6f529d7939 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:56.389206 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9a0f9c7e-8d16-490f-90de-2a6f529d7939 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:56.395864 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9a0f9c7e-8d16-490f-90de-2a6f529d7939 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:56.396378 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9a0f9c7e-8d16-490f-90de-2a6f529d7939 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:56.397228 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9a0f9c7e-8d16-490f-90de-2a6f529d7939 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:56.397742 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9a0f9c7e-8d16-490f-90de-2a6f529d7939 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:56.427681 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9a0f9c7e-8d16-490f-90de-2a6f529d7939 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043189 Dec 13 16:54:56.428230 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 392/793] 10.222.0.62 () {60 vars in 1342 bytes} [Mon Dec 13 16:54:56 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:54:56.488908 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f39ec2be-3959-4ce3-896e-6cdb707acc55 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:56.489508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f39ec2be-3959-4ce3-896e-6cdb707acc55 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:56.502264 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f39ec2be-3959-4ce3-896e-6cdb707acc55 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:56.502884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f39ec2be-3959-4ce3-896e-6cdb707acc55 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:56.504049 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f39ec2be-3959-4ce3-896e-6cdb707acc55 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:56.504634 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f39ec2be-3959-4ce3-896e-6cdb707acc55 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:56.533929 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f39ec2be-3959-4ce3-896e-6cdb707acc55 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:54:56.628610 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f39ec2be-3959-4ce3-896e-6cdb707acc55 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 204 len: 0 microversion: 2.20 time: 0.146574 Dec 13 16:54:56.629799 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 402/794] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Dec 13 16:54:56 2021] DELETE /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 13 16:54:56.642265 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:56.643077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:56.649979 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:56.650417 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:56.651218 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:56.651643 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:56.809367 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:56.822319 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:56.824798 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:56.826601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a1221de3-cf6c-4e3c-84c6-2538fb6c4632 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.190025 Dec 13 16:54:56.827458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 393/795] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:56 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:57.847196 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:57.847883 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:57.855585 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:57.856031 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:57.856983 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:57.857410 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:58.007031 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:58.015449 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:58.016961 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:58.018102 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-66955e67-ff3e-4f87-8da2-dc4c6c54f0b6 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1724 microversion: 2.20 time: 0.175045 Dec 13 16:54:58.018669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 403/796] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:57 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 13 16:54:58.646347 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-419495059", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "9a74d399-a83a-4821-82c3-e489fb3f4179"}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:58.701905 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] validate_networks() for [('9a74d399-a83a-4821-82c3-e489fb3f4179', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:54:59.038030 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:59.038674 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:59.046600 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:59.047043 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:59.047803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:59.048226 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:59.097645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:54:59.098061 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:54:59.098525 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:54:59.098925 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:54:59.099328 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:54:59.108929 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:59.109368 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:59.110178 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:59.110608 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:59.127276 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Getting quotas for project c6d1af29ea9c44a7870cae601abfe353. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:54:59.131266 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Getting quotas for user 431688bdedc6443cb3718b6af3cdcc30 and project c6d1af29ea9c44a7870cae601abfe353. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:54:59.141418 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:59.143199 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:54:59.145592 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:54:59.150067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:59.154430 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9c2500682e64b3a91e811a3ba09bd20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c94e8e265a6f4fb585504a1e95ceda28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:59.156960 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-fdcee275-6d0e-4e42-8f04-5d7c95b4ef80 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 200 len: 1657 microversion: 2.20 time: 0.122657 Dec 13 16:54:59.157694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 404/797] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:54:59 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 1657 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 13 16:54:59.192559 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-b526b887-a9a4-4238-a04d-a96a5bf9958a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550005 Dec 13 16:54:59.193558 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 394/798] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:54:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:54:59.203921 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1f942b63-1de4-4125-a6f8-cc80696257b9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:54:59.204048 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1f942b63-1de4-4125-a6f8-cc80696257b9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:54:59.263913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-e045e2b4-ae7e-4b01-b7ec-59df14a405d3 req-69ed808a-6443-4d3d-81ee-451e058b631d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea34650-4715-472f-a562-e8929cb0f319", "name": "network-vif-deleted", "tag": "823c9158-6eee-4748-8e22-293145c6db04"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:54:59.265670 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:54:59.265670 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:54:59.273545 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-e045e2b4-ae7e-4b01-b7ec-59df14a405d3 req-69ed808a-6443-4d3d-81ee-451e058b631d service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:54:59.274262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-e045e2b4-ae7e-4b01-b7ec-59df14a405d3 req-69ed808a-6443-4d3d-81ee-451e058b631d service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:54:59.288488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1f942b63-1de4-4125-a6f8-cc80696257b9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:54:59.296294 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-e045e2b4-ae7e-4b01-b7ec-59df14a405d3 req-69ed808a-6443-4d3d-81ee-451e058b631d service nova] Creating event network-vif-deleted:823c9158-6eee-4748-8e22-293145c6db04 for instance 3ea34650-4715-472f-a562-e8929cb0f319 on hv-cinder-82160 Dec 13 16:54:59.301986 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-e045e2b4-ae7e-4b01-b7ec-59df14a405d3 req-69ed808a-6443-4d3d-81ee-451e058b631d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041753 Dec 13 16:54:59.302585 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 395/799] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:54:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:54:59.308219 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1f942b63-1de4-4125-a6f8-cc80696257b9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1217 microversion: 2.1 time: 0.108328 Dec 13 16:54:59.310313 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 405/800] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:54:59 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:00.177970 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:00.178729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:00.188557 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:00.189197 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:00.189998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:00.190456 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:00.205403 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] HTTP exception thrown: Instance 3ea34650-4715-472f-a562-e8929cb0f319 could not be found. Dec 13 16:55:00.206273 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Returning 404 to user: Instance 3ea34650-4715-472f-a562-e8929cb0f319 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:55:00.207097 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1c96759b-3265-4c6c-b54b-add88b8cafa7 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 404 len: 111 microversion: 2.20 time: 0.035444 Dec 13 16:55:00.207855 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 396/801] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:55:00 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:55:00.220838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9fc2bde0-dbe6-4cec-8510-5bb4923da5a1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '.version_select at 0x7f213bfc0310>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:00.256893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9fc2bde0-dbe6-4cec-8510-5bb4923da5a1 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431367091" status: 204 len: 0 microversion: 2.20 time: 0.043488 Dec 13 16:55:00.258723 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 406/802] 10.222.0.62 () {60 vars in 1261 bytes} [Mon Dec 13 16:55:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1431367091 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 13 16:55:00.326776 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8b7241d0-c4c1-499e-8d75-99a7873868e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:00.327385 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8b7241d0-c4c1-499e-8d75-99a7873868e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:00.339803 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8b7241d0-c4c1-499e-8d75-99a7873868e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:00.340272 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8b7241d0-c4c1-499e-8d75-99a7873868e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:00.341236 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8b7241d0-c4c1-499e-8d75-99a7873868e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:00.341748 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8b7241d0-c4c1-499e-8d75-99a7873868e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:00.422047 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8b7241d0-c4c1-499e-8d75-99a7873868e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:00.435418 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8b7241d0-c4c1-499e-8d75-99a7873868e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1287 microversion: 2.1 time: 0.112129 Dec 13 16:55:00.436103 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 397/803] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:00 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:01.454167 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-132c002a-d50c-409a-8d0b-8873be08b3ec tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:01.454739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-132c002a-d50c-409a-8d0b-8873be08b3ec tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:01.461578 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-132c002a-d50c-409a-8d0b-8873be08b3ec tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:01.462047 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-132c002a-d50c-409a-8d0b-8873be08b3ec tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:01.462840 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-132c002a-d50c-409a-8d0b-8873be08b3ec tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:01.463277 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-132c002a-d50c-409a-8d0b-8873be08b3ec tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:01.688959 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-4485775b-ee01-47bc-9fb1-160d5bfe8fe7 req-23477d45-13f7-43ef-9019-93715e1f7e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0550d1c-5c78-4f91-b4be-b55d993fee22", "tag": "6e8afb44-d87a-422c-bcae-a93462369a7d"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:01.693211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:01.693211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:55:01.705390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-4485775b-ee01-47bc-9fb1-160d5bfe8fe7 req-23477d45-13f7-43ef-9019-93715e1f7e2b service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:01.705795 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-4485775b-ee01-47bc-9fb1-160d5bfe8fe7 req-23477d45-13f7-43ef-9019-93715e1f7e2b service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:01.713815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-132c002a-d50c-409a-8d0b-8873be08b3ec tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:01.718186 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-4485775b-ee01-47bc-9fb1-160d5bfe8fe7 req-23477d45-13f7-43ef-9019-93715e1f7e2b service nova] Creating event network-changed:6e8afb44-d87a-422c-bcae-a93462369a7d for instance b0550d1c-5c78-4f91-b4be-b55d993fee22 on hv-cinder-82160 Dec 13 16:55:01.723726 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-132c002a-d50c-409a-8d0b-8873be08b3ec tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1317 microversion: 2.1 time: 0.272448 Dec 13 16:55:01.723867 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-4485775b-ee01-47bc-9fb1-160d5bfe8fe7 req-23477d45-13f7-43ef-9019-93715e1f7e2b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039406 Dec 13 16:55:01.723867 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 398/804] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:01.732785 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 407/805] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:01 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:02.155454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:02.156030 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:02.162640 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:02.163086 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:02.163962 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:02.164390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:02.177721 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] HTTP exception thrown: Instance 3ea34650-4715-472f-a562-e8929cb0f319 could not be found. Dec 13 16:55:02.178306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Returning 404 to user: Instance 3ea34650-4715-472f-a562-e8929cb0f319 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:55:02.179207 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9c48970c-a97c-44e8-8809-529fe540e73b tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 404 len: 111 microversion: 2.20 time: 0.027778 Dec 13 16:55:02.179737 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 399/806] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Dec 13 16:55:02 2021] DELETE /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:55:02.187735 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:02.188345 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 3ea34650-4715-472f-a562-e8929cb0f319] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:02.194934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:02.195533 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:02.196354 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:02.196823 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:02.211186 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] HTTP exception thrown: Instance 3ea34650-4715-472f-a562-e8929cb0f319 could not be found. Dec 13 16:55:02.211828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Returning 404 to user: Instance 3ea34650-4715-472f-a562-e8929cb0f319 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:55:02.212753 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-560b5133-b321-44f0-b828-fe6201074cab tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319" status: 404 len: 111 microversion: 2.20 time: 0.028646 Dec 13 16:55:02.213291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 408/807] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:55:02 2021] GET /compute/v2.1/servers/3ea34650-4715-472f-a562-e8929cb0f319 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:55:02.740312 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7b56eab3-24e1-48ce-ab4c-5ecade396eee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:02.741356 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7b56eab3-24e1-48ce-ab4c-5ecade396eee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:02.748815 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7b56eab3-24e1-48ce-ab4c-5ecade396eee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:02.749297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7b56eab3-24e1-48ce-ab4c-5ecade396eee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:02.750086 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7b56eab3-24e1-48ce-ab4c-5ecade396eee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:02.750520 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7b56eab3-24e1-48ce-ab4c-5ecade396eee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:02.890291 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7b56eab3-24e1-48ce-ab4c-5ecade396eee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:02.897721 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7b56eab3-24e1-48ce-ab4c-5ecade396eee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1317 microversion: 2.1 time: 0.161324 Dec 13 16:55:02.898303 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 400/808] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:02 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:03.357718 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:03.358655 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:03.369861 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:03.370304 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:03.371072 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:03.371495 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:03.385474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] HTTP exception thrown: Instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f could not be found. Dec 13 16:55:03.386059 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Returning 404 to user: Instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:55:03.386873 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b223c2e4-ad38-4bed-a284-7214f38edd87 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 404 len: 111 microversion: 2.20 time: 0.034078 Dec 13 16:55:03.387407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 409/809] 10.222.0.62 () {60 vars in 1279 bytes} [Mon Dec 13 16:55:03 2021] DELETE /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:55:03.395684 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:03.396285 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] [instance: 49b9554f-cedc-4ce0-a3d7-c4be33ec154f] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:03.403760 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:03.404202 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:03.405022 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:03.405448 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:03.419458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] HTTP exception thrown: Instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f could not be found. Dec 13 16:55:03.420077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] Returning 404 to user: Instance 49b9554f-cedc-4ce0-a3d7-c4be33ec154f could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:55:03.420917 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d91ea452-c6a6-462f-ae64-c8b35d09ba00 tempest-AttachVolumeShelveTestJSON-55328609 tempest-AttachVolumeShelveTestJSON-55328609-project] 10.222.0.62 "GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f" status: 404 len: 111 microversion: 2.20 time: 0.028993 Dec 13 16:55:03.421421 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 401/810] 10.222.0.62 () {60 vars in 1276 bytes} [Mon Dec 13 16:55:03 2021] GET /compute/v2.1/servers/49b9554f-cedc-4ce0-a3d7-c4be33ec154f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:55:03.914297 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-842dba8b-dcd7-4a69-b1e7-8fb45af72e60 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:03.914907 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-842dba8b-dcd7-4a69-b1e7-8fb45af72e60 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:03.921379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-842dba8b-dcd7-4a69-b1e7-8fb45af72e60 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:03.921821 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-842dba8b-dcd7-4a69-b1e7-8fb45af72e60 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:03.922902 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-842dba8b-dcd7-4a69-b1e7-8fb45af72e60 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:03.923005 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-842dba8b-dcd7-4a69-b1e7-8fb45af72e60 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:04.056842 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-842dba8b-dcd7-4a69-b1e7-8fb45af72e60 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:04.064343 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-842dba8b-dcd7-4a69-b1e7-8fb45af72e60 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1317 microversion: 2.1 time: 0.153944 Dec 13 16:55:04.065179 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 410/811] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:03 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:05.082325 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-80fe7601-9c3b-4b03-aba8-c7d95f033691 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:05.082952 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-80fe7601-9c3b-4b03-aba8-c7d95f033691 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:05.092360 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-80fe7601-9c3b-4b03-aba8-c7d95f033691 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:05.093102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-80fe7601-9c3b-4b03-aba8-c7d95f033691 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:05.094173 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-80fe7601-9c3b-4b03-aba8-c7d95f033691 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:05.094694 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-80fe7601-9c3b-4b03-aba8-c7d95f033691 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:05.612529 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-80fe7601-9c3b-4b03-aba8-c7d95f033691 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:05.622141 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-80fe7601-9c3b-4b03-aba8-c7d95f033691 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1317 microversion: 2.1 time: 0.543649 Dec 13 16:55:05.622728 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 402/812] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:05 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:06.642204 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8481963f-eb56-4404-beab-6db6338f65b8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:06.643363 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8481963f-eb56-4404-beab-6db6338f65b8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:06.654037 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8481963f-eb56-4404-beab-6db6338f65b8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:06.654650 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8481963f-eb56-4404-beab-6db6338f65b8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:06.655716 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8481963f-eb56-4404-beab-6db6338f65b8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:06.656341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8481963f-eb56-4404-beab-6db6338f65b8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:06.931149 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8481963f-eb56-4404-beab-6db6338f65b8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:06.940156 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8481963f-eb56-4404-beab-6db6338f65b8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1317 microversion: 2.1 time: 0.304499 Dec 13 16:55:06.953606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 411/813] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:06 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:06.953857 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-754f988a-1557-4825-b0df-379501319980 req-0391b52e-dc79-4eb8-8f31-39eac4c630bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0550d1c-5c78-4f91-b4be-b55d993fee22", "name": "network-vif-plugged", "status": "completed", "tag": "6e8afb44-d87a-422c-bcae-a93462369a7d"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:06.956603 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:06.956603 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:55:06.967108 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-754f988a-1557-4825-b0df-379501319980 req-0391b52e-dc79-4eb8-8f31-39eac4c630bb service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:06.967515 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-754f988a-1557-4825-b0df-379501319980 req-0391b52e-dc79-4eb8-8f31-39eac4c630bb service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:06.987858 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-754f988a-1557-4825-b0df-379501319980 req-0391b52e-dc79-4eb8-8f31-39eac4c630bb service nova] Creating event network-vif-plugged:6e8afb44-d87a-422c-bcae-a93462369a7d for instance b0550d1c-5c78-4f91-b4be-b55d993fee22 on hv-cinder-82160 Dec 13 16:55:06.993840 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-754f988a-1557-4825-b0df-379501319980 req-0391b52e-dc79-4eb8-8f31-39eac4c630bb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043912 Dec 13 16:55:06.995090 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 403/814] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:07.969943 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c298b44b-1706-4111-9cbc-5e337309eaf3 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:07.970561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c298b44b-1706-4111-9cbc-5e337309eaf3 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:07.977565 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c298b44b-1706-4111-9cbc-5e337309eaf3 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:07.978045 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c298b44b-1706-4111-9cbc-5e337309eaf3 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:07.978821 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c298b44b-1706-4111-9cbc-5e337309eaf3 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:07.979249 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c298b44b-1706-4111-9cbc-5e337309eaf3 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:08.114462 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c298b44b-1706-4111-9cbc-5e337309eaf3 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:08.122812 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c298b44b-1706-4111-9cbc-5e337309eaf3 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1317 microversion: 2.1 time: 0.156562 Dec 13 16:55:08.123380 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 412/815] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:07 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:09.140114 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e9866d7d-11df-496d-b285-ad036d86af80 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:09.140968 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e9866d7d-11df-496d-b285-ad036d86af80 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:09.147914 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e9866d7d-11df-496d-b285-ad036d86af80 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:09.148345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e9866d7d-11df-496d-b285-ad036d86af80 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:09.149230 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e9866d7d-11df-496d-b285-ad036d86af80 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:09.149849 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e9866d7d-11df-496d-b285-ad036d86af80 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:09.298603 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e9866d7d-11df-496d-b285-ad036d86af80 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:09.306613 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e9866d7d-11df-496d-b285-ad036d86af80 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1507 microversion: 2.1 time: 0.170485 Dec 13 16:55:09.307263 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 404/816] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:09 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:09.323740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57052f87-9b7a-44f4-8009-646a0858adb7"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:09.324922 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:09.331220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:09.331666 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:09.332474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:09.332932 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:09.414712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] HTTP exception thrown: Invalid volume: volume 57052f87-9b7a-44f4-8009-646a0858adb7 is already attached to instances: e5af783e-db46-4b24-892e-598e120cd9bf Dec 13 16:55:09.415416 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Returning 400 to user: Invalid volume: volume 57052f87-9b7a-44f4-8009-646a0858adb7 is already attached to instances: e5af783e-db46-4b24-892e-598e120cd9bf {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:55:09.417068 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0f68f9f6-db9c-4670-b850-6d46661ec6bc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096745 Dec 13 16:55:09.417712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 413/817] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:55:09 2021] POST /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:55:09.479059 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d3a9d0d9-77b3-4ece-9a66-44eea7e54822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:09.479542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d3a9d0d9-77b3-4ece-9a66-44eea7e54822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:09.487633 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d3a9d0d9-77b3-4ece-9a66-44eea7e54822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:09.488132 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d3a9d0d9-77b3-4ece-9a66-44eea7e54822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:09.489199 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d3a9d0d9-77b3-4ece-9a66-44eea7e54822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:09.489538 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d3a9d0d9-77b3-4ece-9a66-44eea7e54822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:09.572310 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-d3a9d0d9-77b3-4ece-9a66-44eea7e54822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lazy-loading 'services' on Instance uuid e5af783e-db46-4b24-892e-598e120cd9bf {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:55:09.650306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d3a9d0d9-77b3-4ece-9a66-44eea7e54822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf/os-volume_attachments/57052f87-9b7a-44f4-8009-646a0858adb7" status: 202 len: 0 microversion: 2.1 time: 0.174879 Dec 13 16:55:09.651017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 405/818] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:55:09 2021] DELETE /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf/os-volume_attachments/57052f87-9b7a-44f4-8009-646a0858adb7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:55:09.660050 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0f28b43d-f202-4f8c-b43f-f7f2f2a54c42 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:09.661361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0f28b43d-f202-4f8c-b43f-f7f2f2a54c42 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:09.670782 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f28b43d-f202-4f8c-b43f-f7f2f2a54c42 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:09.671244 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f28b43d-f202-4f8c-b43f-f7f2f2a54c42 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:09.672074 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f28b43d-f202-4f8c-b43f-f7f2f2a54c42 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:09.672487 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f28b43d-f202-4f8c-b43f-f7f2f2a54c42 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:09.708287 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0f28b43d-f202-4f8c-b43f-f7f2f2a54c42 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052248 Dec 13 16:55:09.708665 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 414/819] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:55:09 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:10.720859 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-bae79c84-b887-46c7-b75a-7c177e028b36 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:10.721877 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-bae79c84-b887-46c7-b75a-7c177e028b36 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:10.730623 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bae79c84-b887-46c7-b75a-7c177e028b36 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:10.730623 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bae79c84-b887-46c7-b75a-7c177e028b36 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:10.730623 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bae79c84-b887-46c7-b75a-7c177e028b36 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:10.730623 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bae79c84-b887-46c7-b75a-7c177e028b36 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:10.760332 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-bae79c84-b887-46c7-b75a-7c177e028b36 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044060 Dec 13 16:55:10.760961 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 406/820] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:55:10 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:55:10.912320 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1528234992", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "9a74d399-a83a-4821-82c3-e489fb3f4179"}]}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:10.967293 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] validate_networks() for [('9a74d399-a83a-4821-82c3-e489fb3f4179', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:55:11.462443 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:55:11.462860 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:55:11.463339 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:55:11.463733 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:55:11.464145 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:55:11.474375 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:11.474815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:11.475659 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:11.476765 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:11.495054 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Getting quotas for project c6d1af29ea9c44a7870cae601abfe353. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:55:11.499378 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Getting quotas for user 431688bdedc6443cb3718b6af3cdcc30 and project c6d1af29ea9c44a7870cae601abfe353. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:55:11.511250 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:55:11.514095 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:55:11.566754 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-5cdc6125-7b03-4d99-b612-b0ae53a3ecc1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657961 Dec 13 16:55:11.567407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 415/821] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:55:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:55:11.577744 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5799870a-d4f2-4808-ad94-76da0d95fdf5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:11.578430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5799870a-d4f2-4808-ad94-76da0d95fdf5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:11.642669 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5799870a-d4f2-4808-ad94-76da0d95fdf5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:11.650225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5799870a-d4f2-4808-ad94-76da0d95fdf5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1218 microversion: 2.1 time: 0.076177 Dec 13 16:55:11.650806 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 407/822] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:11 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:12.668893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f1aabc57-45d7-4178-94de-1b272347dbf9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:12.670057 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f1aabc57-45d7-4178-94de-1b272347dbf9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:12.680775 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f1aabc57-45d7-4178-94de-1b272347dbf9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:12.681325 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f1aabc57-45d7-4178-94de-1b272347dbf9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:12.682234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f1aabc57-45d7-4178-94de-1b272347dbf9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:12.689253 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f1aabc57-45d7-4178-94de-1b272347dbf9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:12.779118 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f1aabc57-45d7-4178-94de-1b272347dbf9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:12.787122 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f1aabc57-45d7-4178-94de-1b272347dbf9 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1276 microversion: 2.1 time: 0.123280 Dec 13 16:55:12.796388 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 416/823] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:12 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:13.819269 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-5284539e-34b5-42e4-85c8-5113ba312795 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:13.822575 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-5284539e-34b5-42e4-85c8-5113ba312795 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:13.831055 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5284539e-34b5-42e4-85c8-5113ba312795 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:13.831601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5284539e-34b5-42e4-85c8-5113ba312795 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:13.832529 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5284539e-34b5-42e4-85c8-5113ba312795 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:13.833200 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-5284539e-34b5-42e4-85c8-5113ba312795 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:14.043002 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-5284539e-34b5-42e4-85c8-5113ba312795 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:14.054050 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-0e7f6b71-1b5c-4fa7-8f98-02bbac9dda3b req-441642b9-9a62-4497-9a8f-2ab327eedac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480dcd5e-4e36-4139-bd52-df57f36d3ba6", "tag": "6e87af8a-2f15-4d0b-b805-697a5ab064b5"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:14.056671 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:14.056671 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:55:14.066022 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-0e7f6b71-1b5c-4fa7-8f98-02bbac9dda3b req-441642b9-9a62-4497-9a8f-2ab327eedac7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:14.066454 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-0e7f6b71-1b5c-4fa7-8f98-02bbac9dda3b req-441642b9-9a62-4497-9a8f-2ab327eedac7 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:14.071884 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-5284539e-34b5-42e4-85c8-5113ba312795 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1318 microversion: 2.1 time: 0.256182 Dec 13 16:55:14.073593 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 408/824] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:13 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:14.083780 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-0e7f6b71-1b5c-4fa7-8f98-02bbac9dda3b req-441642b9-9a62-4497-9a8f-2ab327eedac7 service nova] Creating event network-changed:6e87af8a-2f15-4d0b-b805-697a5ab064b5 for instance 480dcd5e-4e36-4139-bd52-df57f36d3ba6 on hv-cinder-82160 Dec 13 16:55:14.100403 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-0e7f6b71-1b5c-4fa7-8f98-02bbac9dda3b req-441642b9-9a62-4497-9a8f-2ab327eedac7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050422 Dec 13 16:55:14.104404 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 417/825] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:15.089840 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cc0fdeb3-2ecb-45b4-b841-925c0e785c5d tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:15.090449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cc0fdeb3-2ecb-45b4-b841-925c0e785c5d tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:15.096868 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cc0fdeb3-2ecb-45b4-b841-925c0e785c5d tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:15.097318 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cc0fdeb3-2ecb-45b4-b841-925c0e785c5d tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:15.098079 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cc0fdeb3-2ecb-45b4-b841-925c0e785c5d tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:15.098511 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cc0fdeb3-2ecb-45b4-b841-925c0e785c5d tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:15.237684 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cc0fdeb3-2ecb-45b4-b841-925c0e785c5d tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:15.245400 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cc0fdeb3-2ecb-45b4-b841-925c0e785c5d tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1318 microversion: 2.1 time: 0.159262 Dec 13 16:55:15.245980 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 409/826] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:15 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:16.267283 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4f022877-51f5-4179-8202-59edbf8744df tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:16.268379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4f022877-51f5-4179-8202-59edbf8744df tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:16.277401 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4f022877-51f5-4179-8202-59edbf8744df tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:16.277849 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4f022877-51f5-4179-8202-59edbf8744df tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:16.278634 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4f022877-51f5-4179-8202-59edbf8744df tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:16.279065 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4f022877-51f5-4179-8202-59edbf8744df tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:16.422730 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4f022877-51f5-4179-8202-59edbf8744df tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:16.430494 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4f022877-51f5-4179-8202-59edbf8744df tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1318 microversion: 2.1 time: 0.170612 Dec 13 16:55:16.431137 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 418/827] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:16 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:17.447882 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f0703ee2-e307-41fa-b6e9-d0bff622cafa tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:17.448495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f0703ee2-e307-41fa-b6e9-d0bff622cafa tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:17.455787 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f0703ee2-e307-41fa-b6e9-d0bff622cafa tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:17.456219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f0703ee2-e307-41fa-b6e9-d0bff622cafa tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:17.457006 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f0703ee2-e307-41fa-b6e9-d0bff622cafa tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:17.457450 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f0703ee2-e307-41fa-b6e9-d0bff622cafa tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:17.599717 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f0703ee2-e307-41fa-b6e9-d0bff622cafa tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:17.607955 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f0703ee2-e307-41fa-b6e9-d0bff622cafa tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1318 microversion: 2.1 time: 0.163620 Dec 13 16:55:17.608519 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 410/828] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:17 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:18.624673 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ab42d9f9-2303-45d7-8a0f-cb53f971c4f8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:18.625280 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ab42d9f9-2303-45d7-8a0f-cb53f971c4f8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:18.632067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ab42d9f9-2303-45d7-8a0f-cb53f971c4f8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:18.632522 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ab42d9f9-2303-45d7-8a0f-cb53f971c4f8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:18.633537 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ab42d9f9-2303-45d7-8a0f-cb53f971c4f8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:18.634003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ab42d9f9-2303-45d7-8a0f-cb53f971c4f8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:18.877107 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-8dd1eb55-c660-4366-8b90-695e5a7e484d req-f6131f17-8c23-4d42-82c4-c2ddbcf251c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480dcd5e-4e36-4139-bd52-df57f36d3ba6", "name": "network-vif-plugged", "status": "completed", "tag": "6e87af8a-2f15-4d0b-b805-697a5ab064b5"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:18.880213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:18.880213 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:55:18.891007 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-8dd1eb55-c660-4366-8b90-695e5a7e484d req-f6131f17-8c23-4d42-82c4-c2ddbcf251c1 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:18.892464 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-8dd1eb55-c660-4366-8b90-695e5a7e484d req-f6131f17-8c23-4d42-82c4-c2ddbcf251c1 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:18.911281 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-8dd1eb55-c660-4366-8b90-695e5a7e484d req-f6131f17-8c23-4d42-82c4-c2ddbcf251c1 service nova] Creating event network-vif-plugged:6e87af8a-2f15-4d0b-b805-697a5ab064b5 for instance 480dcd5e-4e36-4139-bd52-df57f36d3ba6 on hv-cinder-82160 Dec 13 16:55:18.921211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-8dd1eb55-c660-4366-8b90-695e5a7e484d req-f6131f17-8c23-4d42-82c4-c2ddbcf251c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049012 Dec 13 16:55:18.922407 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 411/829] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:19.059096 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ab42d9f9-2303-45d7-8a0f-cb53f971c4f8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:19.066768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ab42d9f9-2303-45d7-8a0f-cb53f971c4f8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1318 microversion: 2.1 time: 0.445790 Dec 13 16:55:19.067339 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 419/830] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:18 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:55:20.089600 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-07aa77e5-3994-4e87-b25c-3eb434897da5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:20.090299 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-07aa77e5-3994-4e87-b25c-3eb434897da5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:20.100206 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-07aa77e5-3994-4e87-b25c-3eb434897da5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:20.100692 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-07aa77e5-3994-4e87-b25c-3eb434897da5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:20.102047 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-07aa77e5-3994-4e87-b25c-3eb434897da5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:20.102582 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-07aa77e5-3994-4e87-b25c-3eb434897da5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:20.253458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-07aa77e5-3994-4e87-b25c-3eb434897da5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:20.261376 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-07aa77e5-3994-4e87-b25c-3eb434897da5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1318 microversion: 2.1 time: 0.178377 Dec 13 16:55:20.261934 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 412/831] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:20 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:21.277996 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2d9fe5a5-ee91-4453-91c7-6c4279f6299b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:21.278772 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-2d9fe5a5-ee91-4453-91c7-6c4279f6299b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:21.285716 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2d9fe5a5-ee91-4453-91c7-6c4279f6299b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:21.286245 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2d9fe5a5-ee91-4453-91c7-6c4279f6299b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:21.287163 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2d9fe5a5-ee91-4453-91c7-6c4279f6299b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:21.287588 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2d9fe5a5-ee91-4453-91c7-6c4279f6299b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:21.467668 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-2d9fe5a5-ee91-4453-91c7-6c4279f6299b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:21.477306 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2d9fe5a5-ee91-4453-91c7-6c4279f6299b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1509 microversion: 2.1 time: 0.203535 Dec 13 16:55:21.478143 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 420/832] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:21 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:22.879716 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cdfe3924-f7fa-405e-a0fb-0112b989c502 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e52c3d3-18be-4dc7-8726-35bbc21f995e"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:22.880932 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cdfe3924-f7fa-405e-a0fb-0112b989c502 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:22.887628 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdfe3924-f7fa-405e-a0fb-0112b989c502 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:22.888074 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdfe3924-f7fa-405e-a0fb-0112b989c502 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:22.888923 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdfe3924-f7fa-405e-a0fb-0112b989c502 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:22.889311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cdfe3924-f7fa-405e-a0fb-0112b989c502 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:23.149097 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cdfe3924-f7fa-405e-a0fb-0112b989c502 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273030 Dec 13 16:55:23.150211 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 413/833] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:55:22 2021] POST /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:32.784837 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e52c3d3-18be-4dc7-8726-35bbc21f995e"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:32.786008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:32.792929 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:32.793551 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:32.794333 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:32.794761 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:32.872579 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] HTTP exception thrown: Invalid volume: volume 3e52c3d3-18be-4dc7-8726-35bbc21f995e is already attached to instances: 480dcd5e-4e36-4139-bd52-df57f36d3ba6 Dec 13 16:55:32.873192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Returning 400 to user: Invalid volume: volume 3e52c3d3-18be-4dc7-8726-35bbc21f995e is already attached to instances: 480dcd5e-4e36-4139-bd52-df57f36d3ba6 {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:55:32.874057 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3884fd52-1880-42ba-b269-b4e6f3430ae5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093446 Dec 13 16:55:32.874609 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 421/834] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:55:32 2021] POST /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 13 16:55:32.943382 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a7a7624a-515c-4e4a-b2f9-8781349d945a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:32.943928 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a7a7624a-515c-4e4a-b2f9-8781349d945a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:32.952119 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a7a7624a-515c-4e4a-b2f9-8781349d945a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:32.952599 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a7a7624a-515c-4e4a-b2f9-8781349d945a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:32.953414 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a7a7624a-515c-4e4a-b2f9-8781349d945a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:32.953850 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a7a7624a-515c-4e4a-b2f9-8781349d945a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:33.034518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-a7a7624a-515c-4e4a-b2f9-8781349d945a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lazy-loading 'services' on Instance uuid 480dcd5e-4e36-4139-bd52-df57f36d3ba6 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:55:33.108184 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a7a7624a-515c-4e4a-b2f9-8781349d945a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "DELETE /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments/3e52c3d3-18be-4dc7-8726-35bbc21f995e" status: 202 len: 0 microversion: 2.1 time: 0.172053 Dec 13 16:55:33.108906 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 414/835] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:55:32 2021] DELETE /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments/3e52c3d3-18be-4dc7-8726-35bbc21f995e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:55:33.118195 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b45e2fc3-caad-4460-9b83-9db49ed79b13 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:33.119111 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b45e2fc3-caad-4460-9b83-9db49ed79b13 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:33.125962 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b45e2fc3-caad-4460-9b83-9db49ed79b13 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:33.126410 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b45e2fc3-caad-4460-9b83-9db49ed79b13 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:33.127296 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b45e2fc3-caad-4460-9b83-9db49ed79b13 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:33.127715 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b45e2fc3-caad-4460-9b83-9db49ed79b13 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:33.160821 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b45e2fc3-caad-4460-9b83-9db49ed79b13 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047251 Dec 13 16:55:33.161634 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 422/836] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:55:33 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:55:34.174751 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3bee9404-d976-443a-9f51-045adfb819c6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:34.175753 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3bee9404-d976-443a-9f51-045adfb819c6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:34.182449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3bee9404-d976-443a-9f51-045adfb819c6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:34.182995 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3bee9404-d976-443a-9f51-045adfb819c6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:34.183797 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3bee9404-d976-443a-9f51-045adfb819c6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:34.184219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3bee9404-d976-443a-9f51-045adfb819c6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:34.215936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3bee9404-d976-443a-9f51-045adfb819c6 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045968 Dec 13 16:55:34.216468 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 415/837] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:55:34 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:55:34.367180 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1135547585", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "9a74d399-a83a-4821-82c3-e489fb3f4179"}]}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:34.419505 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] validate_networks() for [('9a74d399-a83a-4821-82c3-e489fb3f4179', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:55:34.792803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:55:34.793220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:55:34.793681 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:55:34.794076 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:55:34.794475 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:55:34.803835 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:34.804269 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:34.805095 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:34.805517 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:34.821671 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Getting quotas for project c6d1af29ea9c44a7870cae601abfe353. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:55:34.825769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Getting quotas for user 431688bdedc6443cb3718b6af3cdcc30 and project c6d1af29ea9c44a7870cae601abfe353. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:55:34.836970 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:55:34.839354 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:55:34.890088 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b18f10ce-12db-4d03-81e4-8f64efe81643 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526621 Dec 13 16:55:34.890720 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 423/838] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:55:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:55:34.900410 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a6368a17-ba1a-4cad-8131-cdf63c1fd146 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:34.901054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a6368a17-ba1a-4cad-8131-cdf63c1fd146 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:34.953906 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a6368a17-ba1a-4cad-8131-cdf63c1fd146 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:34.960596 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a6368a17-ba1a-4cad-8131-cdf63c1fd146 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1218 microversion: 2.1 time: 0.063754 Dec 13 16:55:34.961182 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 416/839] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:34 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:35.981418 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-102299ea-7b7a-4857-84b7-551d2d8aa6e4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:35.982353 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-102299ea-7b7a-4857-84b7-551d2d8aa6e4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:35.989448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-102299ea-7b7a-4857-84b7-551d2d8aa6e4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:35.989895 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-102299ea-7b7a-4857-84b7-551d2d8aa6e4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:35.990667 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-102299ea-7b7a-4857-84b7-551d2d8aa6e4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:35.991090 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-102299ea-7b7a-4857-84b7-551d2d8aa6e4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:36.064016 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-102299ea-7b7a-4857-84b7-551d2d8aa6e4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:36.075322 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-102299ea-7b7a-4857-84b7-551d2d8aa6e4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1270 microversion: 2.1 time: 0.100160 Dec 13 16:55:36.075917 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 424/840] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:35 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:37.095673 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a3b8866f-9711-4f4f-9d02-6e678f149a0a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:37.096667 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a3b8866f-9711-4f4f-9d02-6e678f149a0a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:37.109095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3b8866f-9711-4f4f-9d02-6e678f149a0a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:37.109825 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3b8866f-9711-4f4f-9d02-6e678f149a0a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:37.111216 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3b8866f-9711-4f4f-9d02-6e678f149a0a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:37.111927 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3b8866f-9711-4f4f-9d02-6e678f149a0a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:37.175881 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a3b8866f-9711-4f4f-9d02-6e678f149a0a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:37.183758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a3b8866f-9711-4f4f-9d02-6e678f149a0a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1270 microversion: 2.1 time: 0.094430 Dec 13 16:55:37.184314 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 417/841] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:37 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:38.202695 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c34a8eac-e472-4637-a672-2a6f2eaf6492 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:38.203754 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c34a8eac-e472-4637-a672-2a6f2eaf6492 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:38.209856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c34a8eac-e472-4637-a672-2a6f2eaf6492 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:38.210296 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c34a8eac-e472-4637-a672-2a6f2eaf6492 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:38.211162 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c34a8eac-e472-4637-a672-2a6f2eaf6492 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:38.211603 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c34a8eac-e472-4637-a672-2a6f2eaf6492 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:38.283233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c34a8eac-e472-4637-a672-2a6f2eaf6492 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:38.292170 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c34a8eac-e472-4637-a672-2a6f2eaf6492 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1270 microversion: 2.1 time: 0.094660 Dec 13 16:55:38.292762 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 425/842] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:38 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:39.310969 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-45f60d4c-2b2f-4d5e-a90a-3ee8da2f6ae1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:39.312227 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-45f60d4c-2b2f-4d5e-a90a-3ee8da2f6ae1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:39.319417 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-45f60d4c-2b2f-4d5e-a90a-3ee8da2f6ae1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:39.320224 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-45f60d4c-2b2f-4d5e-a90a-3ee8da2f6ae1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:39.321297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-45f60d4c-2b2f-4d5e-a90a-3ee8da2f6ae1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:39.321936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-45f60d4c-2b2f-4d5e-a90a-3ee8da2f6ae1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:39.472157 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-45f60d4c-2b2f-4d5e-a90a-3ee8da2f6ae1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:39.480042 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-45f60d4c-2b2f-4d5e-a90a-3ee8da2f6ae1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1318 microversion: 2.1 time: 0.173837 Dec 13 16:55:39.480850 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 418/843] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:39 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:39.861384 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-c6b20c47-a388-4ded-87b2-95ce1d9b7f58 req-22a05eb1-107e-42eb-9cd4-76f95b9d8d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1774ca4a-0112-49ba-adc1-a80eed39d878", "tag": "9e58cfbd-fd33-4469-a060-d4c8591cdb1f"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:39.863028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:39.863028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:55:39.873704 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-c6b20c47-a388-4ded-87b2-95ce1d9b7f58 req-22a05eb1-107e-42eb-9cd4-76f95b9d8d1a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:39.874207 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-c6b20c47-a388-4ded-87b2-95ce1d9b7f58 req-22a05eb1-107e-42eb-9cd4-76f95b9d8d1a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:39.890455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-c6b20c47-a388-4ded-87b2-95ce1d9b7f58 req-22a05eb1-107e-42eb-9cd4-76f95b9d8d1a service nova] Creating event network-changed:9e58cfbd-fd33-4469-a060-d4c8591cdb1f for instance 1774ca4a-0112-49ba-adc1-a80eed39d878 on hv-cinder-82160 Dec 13 16:55:39.895686 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-c6b20c47-a388-4ded-87b2-95ce1d9b7f58 req-22a05eb1-107e-42eb-9cd4-76f95b9d8d1a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039686 Dec 13 16:55:39.896727 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 426/844] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:40.499416 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-223f9065-fb23-486a-ad6d-8a4a418c445e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:40.499977 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-223f9065-fb23-486a-ad6d-8a4a418c445e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:40.506874 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-223f9065-fb23-486a-ad6d-8a4a418c445e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:40.507339 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-223f9065-fb23-486a-ad6d-8a4a418c445e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:40.508141 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-223f9065-fb23-486a-ad6d-8a4a418c445e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:40.508559 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-223f9065-fb23-486a-ad6d-8a4a418c445e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:40.642542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-223f9065-fb23-486a-ad6d-8a4a418c445e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:40.650189 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-223f9065-fb23-486a-ad6d-8a4a418c445e tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1318 microversion: 2.1 time: 0.155562 Dec 13 16:55:40.650786 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 419/845] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:40 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:41.668432 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-550e1a7d-12f7-431b-bf52-b7c1a8870c27 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:41.669018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-550e1a7d-12f7-431b-bf52-b7c1a8870c27 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:41.676114 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-550e1a7d-12f7-431b-bf52-b7c1a8870c27 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:41.676550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-550e1a7d-12f7-431b-bf52-b7c1a8870c27 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:41.677352 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-550e1a7d-12f7-431b-bf52-b7c1a8870c27 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:41.677776 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-550e1a7d-12f7-431b-bf52-b7c1a8870c27 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:41.827742 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-550e1a7d-12f7-431b-bf52-b7c1a8870c27 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:41.839944 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-550e1a7d-12f7-431b-bf52-b7c1a8870c27 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1318 microversion: 2.1 time: 0.175852 Dec 13 16:55:41.840792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 427/846] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:41 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:42.859790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0174554b-4148-433a-bdf9-09c31d248d3a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:42.860588 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0174554b-4148-433a-bdf9-09c31d248d3a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:42.867348 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0174554b-4148-433a-bdf9-09c31d248d3a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:42.867904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0174554b-4148-433a-bdf9-09c31d248d3a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:42.868807 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0174554b-4148-433a-bdf9-09c31d248d3a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:42.869352 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0174554b-4148-433a-bdf9-09c31d248d3a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:43.020707 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-0174554b-4148-433a-bdf9-09c31d248d3a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:43.034592 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0174554b-4148-433a-bdf9-09c31d248d3a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1318 microversion: 2.1 time: 0.179021 Dec 13 16:55:43.044250 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 420/847] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:42 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:44.052723 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8626a060-cc83-492e-b107-f8a22b2ef2a5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:44.053519 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8626a060-cc83-492e-b107-f8a22b2ef2a5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:44.060005 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8626a060-cc83-492e-b107-f8a22b2ef2a5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:44.060669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8626a060-cc83-492e-b107-f8a22b2ef2a5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:44.061800 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8626a060-cc83-492e-b107-f8a22b2ef2a5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:44.062426 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8626a060-cc83-492e-b107-f8a22b2ef2a5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:44.294193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8626a060-cc83-492e-b107-f8a22b2ef2a5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:44.304267 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8626a060-cc83-492e-b107-f8a22b2ef2a5 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1318 microversion: 2.1 time: 0.255909 Dec 13 16:55:44.304848 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 428/848] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:44 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:44.991528 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-6905ff56-0c21-473b-a3f0-c6b1730eed25 req-39d69a7e-3ab1-4142-98f7-3eb310d614fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774ca4a-0112-49ba-adc1-a80eed39d878", "name": "network-vif-plugged", "status": "completed", "tag": "9e58cfbd-fd33-4469-a060-d4c8591cdb1f"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:44.993249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:44.993249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:55:45.001785 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-6905ff56-0c21-473b-a3f0-c6b1730eed25 req-39d69a7e-3ab1-4142-98f7-3eb310d614fc service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:45.002731 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-6905ff56-0c21-473b-a3f0-c6b1730eed25 req-39d69a7e-3ab1-4142-98f7-3eb310d614fc service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:45.015591 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-6905ff56-0c21-473b-a3f0-c6b1730eed25 req-39d69a7e-3ab1-4142-98f7-3eb310d614fc service nova] Creating event network-vif-plugged:9e58cfbd-fd33-4469-a060-d4c8591cdb1f for instance 1774ca4a-0112-49ba-adc1-a80eed39d878 on hv-cinder-82160 Dec 13 16:55:45.020689 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-6905ff56-0c21-473b-a3f0-c6b1730eed25 req-39d69a7e-3ab1-4142-98f7-3eb310d614fc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033240 Dec 13 16:55:45.021287 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 421/849] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:45.322716 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ca394ba0-e0dc-4f6a-9bda-268c184f7d54 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:45.323753 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ca394ba0-e0dc-4f6a-9bda-268c184f7d54 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:45.330647 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ca394ba0-e0dc-4f6a-9bda-268c184f7d54 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:45.331116 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ca394ba0-e0dc-4f6a-9bda-268c184f7d54 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:45.331894 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ca394ba0-e0dc-4f6a-9bda-268c184f7d54 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:45.332354 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ca394ba0-e0dc-4f6a-9bda-268c184f7d54 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:45.492266 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ca394ba0-e0dc-4f6a-9bda-268c184f7d54 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:45.501138 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ca394ba0-e0dc-4f6a-9bda-268c184f7d54 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1318 microversion: 2.1 time: 0.182169 Dec 13 16:55:45.501713 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 429/850] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:45 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:46.064720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-757808920", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "e74fe083-7e31-45b7-9c66-7e0a2e947689"}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:46.119657 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] validate_networks() for [('e74fe083-7e31-45b7-9c66-7e0a2e947689', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:55:46.485877 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:55:46.486295 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:55:46.486758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:55:46.487163 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:55:46.487601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:55:46.497285 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:46.497726 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:46.498593 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:46.499051 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:46.518442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a702f8d9-a363-4989-ad23-f7f47cb3dafc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:46.519059 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a702f8d9-a363-4989-ad23-f7f47cb3dafc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:46.525394 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Getting quotas for project c2c012e0f9a44258850f7026e65a6ec2. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:55:46.525715 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a702f8d9-a363-4989-ad23-f7f47cb3dafc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:46.526393 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a702f8d9-a363-4989-ad23-f7f47cb3dafc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:46.527173 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a702f8d9-a363-4989-ad23-f7f47cb3dafc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:46.527589 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a702f8d9-a363-4989-ad23-f7f47cb3dafc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:46.529830 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Getting quotas for user 8501035d3f3c4a46a05b72b8234befac and project c2c012e0f9a44258850f7026e65a6ec2. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:55:46.541376 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:55:46.543822 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:55:46.590330 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0eea080e-3ca0-4ba7-bfc7-c169a76d7948 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530923 Dec 13 16:55:46.590977 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 422/851] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:55:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:55:46.601083 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d3b9f226-b505-4684-947b-2ddcecebd9f9 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:46.602056 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d3b9f226-b505-4684-947b-2ddcecebd9f9 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:46.671318 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d3b9f226-b505-4684-947b-2ddcecebd9f9 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:46.678649 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a702f8d9-a363-4989-ad23-f7f47cb3dafc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:46.679979 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d3b9f226-b505-4684-947b-2ddcecebd9f9 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1213 microversion: 2.1 time: 0.082639 Dec 13 16:55:46.680974 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 423/852] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:46 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:55:46.686047 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a702f8d9-a363-4989-ad23-f7f47cb3dafc tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1318 microversion: 2.1 time: 0.171089 Dec 13 16:55:46.686602 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 430/853] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:46 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:47.703671 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-aac88d0d-c476-482c-8504-526c2580445b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:47.704370 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bddcaa21-a3a4-4b66-811b-471b162b0b4a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:47.705261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bddcaa21-a3a4-4b66-811b-471b162b0b4a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:47.705739 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-aac88d0d-c476-482c-8504-526c2580445b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:47.713766 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aac88d0d-c476-482c-8504-526c2580445b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:47.714480 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bddcaa21-a3a4-4b66-811b-471b162b0b4a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:47.714664 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aac88d0d-c476-482c-8504-526c2580445b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:47.715497 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bddcaa21-a3a4-4b66-811b-471b162b0b4a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:47.716460 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aac88d0d-c476-482c-8504-526c2580445b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:47.716864 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bddcaa21-a3a4-4b66-811b-471b162b0b4a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:47.717103 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aac88d0d-c476-482c-8504-526c2580445b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:47.717710 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bddcaa21-a3a4-4b66-811b-471b162b0b4a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:47.785915 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-aac88d0d-c476-482c-8504-526c2580445b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:47.793470 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-aac88d0d-c476-482c-8504-526c2580445b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1273 microversion: 2.1 time: 0.096095 Dec 13 16:55:47.794119 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 424/854] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:47 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:47.959876 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bddcaa21-a3a4-4b66-811b-471b162b0b4a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:47.967674 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bddcaa21-a3a4-4b66-811b-471b162b0b4a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1509 microversion: 2.1 time: 0.268799 Dec 13 16:55:47.979455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 431/855] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:47 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:48.813966 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-aedbdc06-c9c8-4d11-8cc3-5ac0823165f6 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:48.814648 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-aedbdc06-c9c8-4d11-8cc3-5ac0823165f6 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:48.821013 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aedbdc06-c9c8-4d11-8cc3-5ac0823165f6 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:48.821468 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aedbdc06-c9c8-4d11-8cc3-5ac0823165f6 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:48.822223 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aedbdc06-c9c8-4d11-8cc3-5ac0823165f6 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:48.822685 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-aedbdc06-c9c8-4d11-8cc3-5ac0823165f6 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:48.961842 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-aedbdc06-c9c8-4d11-8cc3-5ac0823165f6 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:48.970034 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-aedbdc06-c9c8-4d11-8cc3-5ac0823165f6 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1313 microversion: 2.1 time: 0.161536 Dec 13 16:55:48.970607 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 425/856] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:48 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:49.099150 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-461a2f39-dd52-43a1-9c9c-001460e59ad1 req-863be3fd-8c46-4e3a-92b1-503368baad2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5047349b-f5f7-4e5c-b9b3-6c7b380088cf", "tag": "371d605f-227a-4b27-8835-3603576e9a6c"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:49.101036 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:49.101036 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:55:49.110934 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-461a2f39-dd52-43a1-9c9c-001460e59ad1 req-863be3fd-8c46-4e3a-92b1-503368baad2a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:49.111377 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-461a2f39-dd52-43a1-9c9c-001460e59ad1 req-863be3fd-8c46-4e3a-92b1-503368baad2a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:49.123397 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-461a2f39-dd52-43a1-9c9c-001460e59ad1 req-863be3fd-8c46-4e3a-92b1-503368baad2a service nova] Creating event network-changed:371d605f-227a-4b27-8835-3603576e9a6c for instance 5047349b-f5f7-4e5c-b9b3-6c7b380088cf on hv-cinder-82160 Dec 13 16:55:49.128938 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-461a2f39-dd52-43a1-9c9c-001460e59ad1 req-863be3fd-8c46-4e3a-92b1-503368baad2a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034034 Dec 13 16:55:49.129536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 432/857] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:49.287089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-c45158cb-f3f7-4508-98e6-54ed7ff6f822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd7033f0-72c4-45a9-bb0c-08cc3a981820"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:49.288210 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-c45158cb-f3f7-4508-98e6-54ed7ff6f822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:49.294458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c45158cb-f3f7-4508-98e6-54ed7ff6f822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:49.294905 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c45158cb-f3f7-4508-98e6-54ed7ff6f822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:49.295690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c45158cb-f3f7-4508-98e6-54ed7ff6f822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:49.296263 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-c45158cb-f3f7-4508-98e6-54ed7ff6f822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:49.544505 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-c45158cb-f3f7-4508-98e6-54ed7ff6f822 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "POST /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261307 Dec 13 16:55:49.545352 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 426/858] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:55:49 2021] POST /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:49.987426 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7afb16fd-8bdb-4f4c-a45d-9fa08bb3fdc8 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:49.988261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7afb16fd-8bdb-4f4c-a45d-9fa08bb3fdc8 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:49.995104 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7afb16fd-8bdb-4f4c-a45d-9fa08bb3fdc8 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:49.995659 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7afb16fd-8bdb-4f4c-a45d-9fa08bb3fdc8 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:49.996422 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7afb16fd-8bdb-4f4c-a45d-9fa08bb3fdc8 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:49.996876 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7afb16fd-8bdb-4f4c-a45d-9fa08bb3fdc8 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:50.409783 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7afb16fd-8bdb-4f4c-a45d-9fa08bb3fdc8 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:50.417917 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7afb16fd-8bdb-4f4c-a45d-9fa08bb3fdc8 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1313 microversion: 2.1 time: 0.434777 Dec 13 16:55:50.418506 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 433/859] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:49 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:51.441060 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a3272202-4487-4d55-a9e2-b8d54813815c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:51.441944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a3272202-4487-4d55-a9e2-b8d54813815c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:51.448454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3272202-4487-4d55-a9e2-b8d54813815c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:51.448940 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3272202-4487-4d55-a9e2-b8d54813815c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:51.449722 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3272202-4487-4d55-a9e2-b8d54813815c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:51.450148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a3272202-4487-4d55-a9e2-b8d54813815c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:51.589510 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a3272202-4487-4d55-a9e2-b8d54813815c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:51.600800 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a3272202-4487-4d55-a9e2-b8d54813815c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1313 microversion: 2.1 time: 0.164018 Dec 13 16:55:51.601583 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 427/860] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:51 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:52.622647 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-45ae9df5-8b7b-40a8-8e6e-6b96cb5e53c4 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:52.625206 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-45ae9df5-8b7b-40a8-8e6e-6b96cb5e53c4 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:52.632096 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-45ae9df5-8b7b-40a8-8e6e-6b96cb5e53c4 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:52.632585 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-45ae9df5-8b7b-40a8-8e6e-6b96cb5e53c4 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:52.633379 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-45ae9df5-8b7b-40a8-8e6e-6b96cb5e53c4 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:52.633805 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-45ae9df5-8b7b-40a8-8e6e-6b96cb5e53c4 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:52.768513 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-45ae9df5-8b7b-40a8-8e6e-6b96cb5e53c4 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:52.775838 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-45ae9df5-8b7b-40a8-8e6e-6b96cb5e53c4 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1313 microversion: 2.1 time: 0.159615 Dec 13 16:55:52.776396 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 434/861] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:52 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:52.778496 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 16:55:52.778984 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 16:55:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 16:55:53.027635 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-88b4e529-55c8-400e-bfb5-4d3e5fb3074c req-90e1f345-e062-4bd3-ba42-e2a2125eaea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5047349b-f5f7-4e5c-b9b3-6c7b380088cf", "name": "network-vif-plugged", "status": "completed", "tag": "371d605f-227a-4b27-8835-3603576e9a6c"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:53.029397 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:53.029397 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:55:53.039235 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-88b4e529-55c8-400e-bfb5-4d3e5fb3074c req-90e1f345-e062-4bd3-ba42-e2a2125eaea3 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:53.039783 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-88b4e529-55c8-400e-bfb5-4d3e5fb3074c req-90e1f345-e062-4bd3-ba42-e2a2125eaea3 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:53.052809 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-88b4e529-55c8-400e-bfb5-4d3e5fb3074c req-90e1f345-e062-4bd3-ba42-e2a2125eaea3 service nova] Creating event network-vif-plugged:371d605f-227a-4b27-8835-3603576e9a6c for instance 5047349b-f5f7-4e5c-b9b3-6c7b380088cf on hv-cinder-82160 Dec 13 16:55:53.057659 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-88b4e529-55c8-400e-bfb5-4d3e5fb3074c req-90e1f345-e062-4bd3-ba42-e2a2125eaea3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033816 Dec 13 16:55:53.058253 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 428/862] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:53.795138 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8a3fbea6-1456-43cc-b8ed-599ea0b8704e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:53.795976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8a3fbea6-1456-43cc-b8ed-599ea0b8704e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:53.803079 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a3fbea6-1456-43cc-b8ed-599ea0b8704e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:53.803552 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a3fbea6-1456-43cc-b8ed-599ea0b8704e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:53.804323 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a3fbea6-1456-43cc-b8ed-599ea0b8704e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:53.804786 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8a3fbea6-1456-43cc-b8ed-599ea0b8704e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:53.949373 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8a3fbea6-1456-43cc-b8ed-599ea0b8704e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:53.957394 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8a3fbea6-1456-43cc-b8ed-599ea0b8704e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1313 microversion: 2.1 time: 0.167935 Dec 13 16:55:53.957950 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 435/863] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:53 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:54.978065 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3a7ddb14-b68d-4de3-9c4e-506c13d4e96e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:54.978997 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3a7ddb14-b68d-4de3-9c4e-506c13d4e96e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:54.989556 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb14-b68d-4de3-9c4e-506c13d4e96e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:54.990251 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb14-b68d-4de3-9c4e-506c13d4e96e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:54.991913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb14-b68d-4de3-9c4e-506c13d4e96e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:54.992845 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3a7ddb14-b68d-4de3-9c4e-506c13d4e96e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:55.152122 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3a7ddb14-b68d-4de3-9c4e-506c13d4e96e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:55.160101 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3a7ddb14-b68d-4de3-9c4e-506c13d4e96e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1497 microversion: 2.1 time: 0.188423 Dec 13 16:55:55.160711 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 429/864] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:54 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:55.584183 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0f2d1ce4-9a7a-4aed-a743-c7739da421a3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:55.584778 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0f2d1ce4-9a7a-4aed-a743-c7739da421a3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:55.591351 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f2d1ce4-9a7a-4aed-a743-c7739da421a3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:55.591792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f2d1ce4-9a7a-4aed-a743-c7739da421a3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:55.594200 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f2d1ce4-9a7a-4aed-a743-c7739da421a3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:55.594200 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0f2d1ce4-9a7a-4aed-a743-c7739da421a3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:55.618479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0f2d1ce4-9a7a-4aed-a743-c7739da421a3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:55:55.697439 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0f2d1ce4-9a7a-4aed-a743-c7739da421a3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 204 len: 0 microversion: 2.1 time: 0.116657 Dec 13 16:55:55.698189 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 436/865] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:55:55 2021] DELETE /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:55:55.707812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9c0f2793-5c91-4e32-80ee-bd3a58300628 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:55.708420 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9c0f2793-5c91-4e32-80ee-bd3a58300628 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:55.715254 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9c0f2793-5c91-4e32-80ee-bd3a58300628 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:55.715732 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9c0f2793-5c91-4e32-80ee-bd3a58300628 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:55.716561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9c0f2793-5c91-4e32-80ee-bd3a58300628 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:55.717039 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9c0f2793-5c91-4e32-80ee-bd3a58300628 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:55.851570 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9c0f2793-5c91-4e32-80ee-bd3a58300628 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:55.859317 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9c0f2793-5c91-4e32-80ee-bd3a58300628 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1503 microversion: 2.1 time: 0.155392 Dec 13 16:55:55.859870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 430/866] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:55 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:56.881556 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3293cd55-a257-4f57-aa7c-03abceedc88b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:56.882828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3293cd55-a257-4f57-aa7c-03abceedc88b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:56.892944 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3293cd55-a257-4f57-aa7c-03abceedc88b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:56.893395 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3293cd55-a257-4f57-aa7c-03abceedc88b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:56.894161 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3293cd55-a257-4f57-aa7c-03abceedc88b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:56.894583 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3293cd55-a257-4f57-aa7c-03abceedc88b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:57.037621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3293cd55-a257-4f57-aa7c-03abceedc88b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:57.047053 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3293cd55-a257-4f57-aa7c-03abceedc88b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1503 microversion: 2.1 time: 0.172259 Dec 13 16:55:57.048701 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 437/867] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:56 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:57.174914 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-744733d7-7f5e-419a-b80b-4d1a35c41b53 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:57.175442 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-744733d7-7f5e-419a-b80b-4d1a35c41b53 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:57.182454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-744733d7-7f5e-419a-b80b-4d1a35c41b53 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:57.182904 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-744733d7-7f5e-419a-b80b-4d1a35c41b53 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:57.183687 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-744733d7-7f5e-419a-b80b-4d1a35c41b53 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:57.184124 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-744733d7-7f5e-419a-b80b-4d1a35c41b53 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:57.270450 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-744733d7-7f5e-419a-b80b-4d1a35c41b53 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lazy-loading 'services' on Instance uuid 1774ca4a-0112-49ba-adc1-a80eed39d878 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:55:57.347085 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-744733d7-7f5e-419a-b80b-4d1a35c41b53 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878/os-volume_attachments/bd7033f0-72c4-45a9-bb0c-08cc3a981820" status: 202 len: 0 microversion: 2.1 time: 0.176591 Dec 13 16:55:57.347737 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 431/868] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:55:57 2021] DELETE /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878/os-volume_attachments/bd7033f0-72c4-45a9-bb0c-08cc3a981820 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:55:57.361872 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d344a0d9-8769-4db2-8a95-0557ee90fb01 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:57.363220 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d344a0d9-8769-4db2-8a95-0557ee90fb01 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:57.369793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d344a0d9-8769-4db2-8a95-0557ee90fb01 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:57.370914 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d344a0d9-8769-4db2-8a95-0557ee90fb01 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:57.371756 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d344a0d9-8769-4db2-8a95-0557ee90fb01 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:57.372371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d344a0d9-8769-4db2-8a95-0557ee90fb01 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:57.404018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d344a0d9-8769-4db2-8a95-0557ee90fb01 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051744 Dec 13 16:55:57.404682 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 438/869] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:55:57 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:57.730232 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-ee294512-8880-4311-9419-993b4454937c req-cfe8a4bc-ff2d-4d10-ba60-e76cbc1cc475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5047349b-f5f7-4e5c-b9b3-6c7b380088cf", "name": "network-vif-deleted", "tag": "371d605f-227a-4b27-8835-3603576e9a6c"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:57.732185 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:55:57.732185 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:55:57.741048 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-ee294512-8880-4311-9419-993b4454937c req-cfe8a4bc-ff2d-4d10-ba60-e76cbc1cc475 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:57.741606 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-ee294512-8880-4311-9419-993b4454937c req-cfe8a4bc-ff2d-4d10-ba60-e76cbc1cc475 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:57.754706 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-ee294512-8880-4311-9419-993b4454937c req-cfe8a4bc-ff2d-4d10-ba60-e76cbc1cc475 service nova] Creating event network-vif-deleted:371d605f-227a-4b27-8835-3603576e9a6c for instance 5047349b-f5f7-4e5c-b9b3-6c7b380088cf on hv-cinder-82160 Dec 13 16:55:57.759713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-ee294512-8880-4311-9419-993b4454937c req-cfe8a4bc-ff2d-4d10-ba60-e76cbc1cc475 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 Dec 13 16:55:57.760366 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 432/870] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:55:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:55:58.065600 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:58.066595 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:58.074629 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:58.075069 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:58.075841 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:58.076263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:58.109197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:58.110693 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:58.111251 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lazy-loading 'fault' on Instance uuid 5047349b-f5f7-4e5c-b9b3-6c7b380088cf {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:55:58.157513 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:58.168247 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d33196f6-4d9d-4fd4-9efa-12d7ecb8683c tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 200 len: 1303 microversion: 2.1 time: 0.106455 Dec 13 16:55:58.168856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 439/871] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:58 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:55:58.420653 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-836222a2-0fe0-4250-b969-346a16803be4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:58.421987 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-836222a2-0fe0-4250-b969-346a16803be4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:58.429189 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-836222a2-0fe0-4250-b969-346a16803be4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:58.429645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-836222a2-0fe0-4250-b969-346a16803be4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:58.430408 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-836222a2-0fe0-4250-b969-346a16803be4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:58.430830 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-836222a2-0fe0-4250-b969-346a16803be4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:58.461223 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-836222a2-0fe0-4250-b969-346a16803be4 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047679 Dec 13 16:55:58.461778 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 433/872] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:55:58 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:55:59.190536 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:59.191537 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 5047349b-f5f7-4e5c-b9b3-6c7b380088cf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:59.202470 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:59.203196 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:59.204605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:59.205102 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:59.219383 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] HTTP exception thrown: Instance 5047349b-f5f7-4e5c-b9b3-6c7b380088cf could not be found. Dec 13 16:55:59.220023 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Returning 404 to user: Instance 5047349b-f5f7-4e5c-b9b3-6c7b380088cf could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:55:59.220886 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-807426de-811f-4fa6-948e-4c5cf8d34ceb tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf" status: 404 len: 111 microversion: 2.1 time: 0.037245 Dec 13 16:55:59.221410 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 440/873] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:59 2021] GET /compute/v2.1/servers/5047349b-f5f7-4e5c-b9b3-6c7b380088cf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:55:59.278609 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1203301271", "imageRef": "9ad65eff-067c-415f-bcdd-8c52cbe10a21", "flavorRef": "452", "networks": [{"uuid": "e74fe083-7e31-45b7-9c66-7e0a2e947689"}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:55:59.336786 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] validate_networks() for [('e74fe083-7e31-45b7-9c66-7e0a2e947689', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:55:59.687463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f28ee67d-901e-4d9e-b0bc-348cef5354ee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:59.688029 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f28ee67d-901e-4d9e-b0bc-348cef5354ee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:59.694540 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f28ee67d-901e-4d9e-b0bc-348cef5354ee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:59.694979 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f28ee67d-901e-4d9e-b0bc-348cef5354ee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:59.695758 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f28ee67d-901e-4d9e-b0bc-348cef5354ee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:59.696178 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f28ee67d-901e-4d9e-b0bc-348cef5354ee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:59.697970 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:55:59.698465 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:55:59.699180 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:55:59.699652 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:55:59.700177 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:55:59.711341 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:59.711789 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:59.712707 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:59.713196 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:59.724368 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f28ee67d-901e-4d9e-b0bc-348cef5354ee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:55:59.730484 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Getting quotas for project c2c012e0f9a44258850f7026e65a6ec2. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:55:59.735110 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Getting quotas for user 8501035d3f3c4a46a05b72b8234befac and project c2c012e0f9a44258850f7026e65a6ec2. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:55:59.749312 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:55:59.752561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9ad65eff-067c-415f-bcdd-8c52cbe10a21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:55:59.799459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e6169598-7e41-47de-9c45-be93c5c03d72 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524200 Dec 13 16:55:59.800331 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 434/874] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:55:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:55:59.810132 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4f531863-9a84-4add-90d0-427b135c68b3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:59.811208 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4f531863-9a84-4add-90d0-427b135c68b3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:59.829906 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f28ee67d-901e-4d9e-b0bc-348cef5354ee tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 204 len: 0 microversion: 2.1 time: 0.145817 Dec 13 16:55:59.830616 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 441/875] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:55:59 2021] DELETE /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:55:59.838621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2cbf64fc-d1e2-4315-95b5-2d8bff5087ac tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:55:59.839453 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-2cbf64fc-d1e2-4315-95b5-2d8bff5087ac tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:55:59.846455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2cbf64fc-d1e2-4315-95b5-2d8bff5087ac tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:59.846902 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2cbf64fc-d1e2-4315-95b5-2d8bff5087ac tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:59.847683 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2cbf64fc-d1e2-4315-95b5-2d8bff5087ac tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:55:59.848141 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2cbf64fc-d1e2-4315-95b5-2d8bff5087ac tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:55:59.866988 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4f531863-9a84-4add-90d0-427b135c68b3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:55:59.873650 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4f531863-9a84-4add-90d0-427b135c68b3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1214 microversion: 2.1 time: 0.067210 Dec 13 16:55:59.874221 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 435/876] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:59 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:55:59.992983 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-2cbf64fc-d1e2-4315-95b5-2d8bff5087ac tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:00.000541 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2cbf64fc-d1e2-4315-95b5-2d8bff5087ac tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1515 microversion: 2.1 time: 0.165749 Dec 13 16:56:00.001318 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 442/877] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:55:59 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:00.889910 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-bf3d6840-4321-4047-9564-d5d9e7d7ce74 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:00.890554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-bf3d6840-4321-4047-9564-d5d9e7d7ce74 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:00.898022 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf3d6840-4321-4047-9564-d5d9e7d7ce74 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:00.898589 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf3d6840-4321-4047-9564-d5d9e7d7ce74 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:00.899440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf3d6840-4321-4047-9564-d5d9e7d7ce74 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:00.899966 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf3d6840-4321-4047-9564-d5d9e7d7ce74 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:00.961561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-bf3d6840-4321-4047-9564-d5d9e7d7ce74 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:00.970268 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-bf3d6840-4321-4047-9564-d5d9e7d7ce74 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1284 microversion: 2.1 time: 0.083490 Dec 13 16:56:00.971290 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 436/878] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:00 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:01.018400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ff3e101a-5455-441e-934e-2bf229a0701c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:01.019334 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ff3e101a-5455-441e-934e-2bf229a0701c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:01.025892 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff3e101a-5455-441e-934e-2bf229a0701c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:01.026324 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff3e101a-5455-441e-934e-2bf229a0701c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:01.027098 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff3e101a-5455-441e-934e-2bf229a0701c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:01.027518 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff3e101a-5455-441e-934e-2bf229a0701c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:01.269475 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ff3e101a-5455-441e-934e-2bf229a0701c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:01.278878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ff3e101a-5455-441e-934e-2bf229a0701c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1515 microversion: 2.1 time: 0.264265 Dec 13 16:56:01.279464 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 443/879] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:01 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:01.988047 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8f9b2640-e7d1-4c84-aca0-36d9d6c55934 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:01.989219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8f9b2640-e7d1-4c84-aca0-36d9d6c55934 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:01.995815 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8f9b2640-e7d1-4c84-aca0-36d9d6c55934 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:01.997056 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8f9b2640-e7d1-4c84-aca0-36d9d6c55934 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:01.998045 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8f9b2640-e7d1-4c84-aca0-36d9d6c55934 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:01.998472 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8f9b2640-e7d1-4c84-aca0-36d9d6c55934 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.022150 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-dfbcf00d-a516-440a-b7f0-ead12ed0d8ba tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:02.022718 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-dfbcf00d-a516-440a-b7f0-ead12ed0d8ba tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:02.029165 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dfbcf00d-a516-440a-b7f0-ead12ed0d8ba tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:02.029636 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dfbcf00d-a516-440a-b7f0-ead12ed0d8ba tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.030422 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dfbcf00d-a516-440a-b7f0-ead12ed0d8ba tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:02.030852 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dfbcf00d-a516-440a-b7f0-ead12ed0d8ba tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.065743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-dfbcf00d-a516-440a-b7f0-ead12ed0d8ba tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lazy-loading 'flavor' on Instance uuid 895f7640-e4b3-4cb0-9632-d99cef54dab6 {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:56:02.154428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-dfbcf00d-a516-440a-b7f0-ead12ed0d8ba tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "POST /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6/action" status: 202 len: 0 microversion: 2.1 time: 0.135817 Dec 13 16:56:02.159335 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 444/880] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:56:02 2021] POST /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:56:02.174889 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e81a6eb6-62a7-475d-821f-ad4a8c55cb26 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:02.175813 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e81a6eb6-62a7-475d-821f-ad4a8c55cb26 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:02.184505 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e81a6eb6-62a7-475d-821f-ad4a8c55cb26 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:02.185317 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e81a6eb6-62a7-475d-821f-ad4a8c55cb26 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.186144 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e81a6eb6-62a7-475d-821f-ad4a8c55cb26 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:02.186861 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e81a6eb6-62a7-475d-821f-ad4a8c55cb26 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.255894 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8f9b2640-e7d1-4c84-aca0-36d9d6c55934 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:02.271077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8f9b2640-e7d1-4c84-aca0-36d9d6c55934 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1314 microversion: 2.1 time: 0.286830 Dec 13 16:56:02.271691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 437/881] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:01 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:02.286915 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-ed79958a-eb9b-40e6-9a11-33b5aca51502 req-d78bfa03-4524-443c-97ef-d96d10de8971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277", "tag": "13b338b1-08ca-43cf-9332-977c23a3e08b"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:02.288500 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:02.288500 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:56:02.297454 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-ed79958a-eb9b-40e6-9a11-33b5aca51502 req-d78bfa03-4524-443c-97ef-d96d10de8971 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:02.297880 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-ed79958a-eb9b-40e6-9a11-33b5aca51502 req-d78bfa03-4524-443c-97ef-d96d10de8971 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.312856 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-ed79958a-eb9b-40e6-9a11-33b5aca51502 req-d78bfa03-4524-443c-97ef-d96d10de8971 service nova] Creating event network-changed:13b338b1-08ca-43cf-9332-977c23a3e08b for instance 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 on hv-cinder-82160 Dec 13 16:56:02.334512 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-ed79958a-eb9b-40e6-9a11-33b5aca51502 req-d78bfa03-4524-443c-97ef-d96d10de8971 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059175 Dec 13 16:56:02.337108 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 438/882] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:56:02.344597 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fbebba9e-9bc1-41e3-a2ee-dad49bcfe1e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:02.345808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fbebba9e-9bc1-41e3-a2ee-dad49bcfe1e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:02.352914 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fbebba9e-9bc1-41e3-a2ee-dad49bcfe1e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:02.353390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fbebba9e-9bc1-41e3-a2ee-dad49bcfe1e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.354158 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fbebba9e-9bc1-41e3-a2ee-dad49bcfe1e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:02.354585 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fbebba9e-9bc1-41e3-a2ee-dad49bcfe1e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.425158 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-fbebba9e-9bc1-41e3-a2ee-dad49bcfe1e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:02.435075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fbebba9e-9bc1-41e3-a2ee-dad49bcfe1e0 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 200 len: 1303 microversion: 2.1 time: 0.096404 Dec 13 16:56:02.441072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 439/883] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:02 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:02.442606 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-f47c87e7-def5-48c4-b425-b796622d119f req-d89e2008-7c8e-454d-b457-b7c9ca449634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1774ca4a-0112-49ba-adc1-a80eed39d878", "name": "network-vif-deleted", "tag": "9e58cfbd-fd33-4469-a060-d4c8591cdb1f"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:02.444430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:02.444430 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:56:02.452491 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-f47c87e7-def5-48c4-b425-b796622d119f req-d89e2008-7c8e-454d-b457-b7c9ca449634 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:02.453408 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-f47c87e7-def5-48c4-b425-b796622d119f req-d89e2008-7c8e-454d-b457-b7c9ca449634 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:02.467762 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-f47c87e7-def5-48c4-b425-b796622d119f req-d89e2008-7c8e-454d-b457-b7c9ca449634 service nova] Creating event network-vif-deleted:9e58cfbd-fd33-4469-a060-d4c8591cdb1f for instance 1774ca4a-0112-49ba-adc1-a80eed39d878 on hv-cinder-82160 Dec 13 16:56:02.475273 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-f47c87e7-def5-48c4-b425-b796622d119f req-d89e2008-7c8e-454d-b457-b7c9ca449634 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036942 Dec 13 16:56:02.476278 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 440/884] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:56:02.511693 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e81a6eb6-62a7-475d-821f-ad4a8c55cb26 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:02.520135 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e81a6eb6-62a7-475d-821f-ad4a8c55cb26 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.349797 Dec 13 16:56:02.520743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 445/885] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:02 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:03.289960 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ba020921-601b-4728-8268-cd5c9accd1ba tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:03.290565 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ba020921-601b-4728-8268-cd5c9accd1ba tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:03.297092 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ba020921-601b-4728-8268-cd5c9accd1ba tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:03.297535 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ba020921-601b-4728-8268-cd5c9accd1ba tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:03.298351 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ba020921-601b-4728-8268-cd5c9accd1ba tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:03.298780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ba020921-601b-4728-8268-cd5c9accd1ba tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:03.436305 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ba020921-601b-4728-8268-cd5c9accd1ba tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:03.444107 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ba020921-601b-4728-8268-cd5c9accd1ba tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1314 microversion: 2.1 time: 0.159270 Dec 13 16:56:03.444741 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 441/886] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:03 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:03.451261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:03.451875 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 1774ca4a-0112-49ba-adc1-a80eed39d878] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:03.458588 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:03.459040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:03.459824 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:03.460253 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:03.474012 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] HTTP exception thrown: Instance 1774ca4a-0112-49ba-adc1-a80eed39d878 could not be found. Dec 13 16:56:03.474600 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Returning 404 to user: Instance 1774ca4a-0112-49ba-adc1-a80eed39d878 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:56:03.475425 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a3b5069c-ebde-4ccf-b296-0fcc37a2b091 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878" status: 404 len: 111 microversion: 2.1 time: 0.027928 Dec 13 16:56:03.475954 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 446/887] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:03 2021] GET /compute/v2.1/servers/1774ca4a-0112-49ba-adc1-a80eed39d878 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:56:03.543685 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-39e2fdd3-654c-4a3f-a653-78a356894599 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:03.544527 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-39e2fdd3-654c-4a3f-a653-78a356894599 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:03.552820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-39e2fdd3-654c-4a3f-a653-78a356894599 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:03.553243 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-39e2fdd3-654c-4a3f-a653-78a356894599 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:03.554323 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-39e2fdd3-654c-4a3f-a653-78a356894599 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:03.554879 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-39e2fdd3-654c-4a3f-a653-78a356894599 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:03.704001 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-39e2fdd3-654c-4a3f-a653-78a356894599 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:03.711862 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-39e2fdd3-654c-4a3f-a653-78a356894599 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.174465 Dec 13 16:56:03.712432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 442/888] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:03 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:04.464973 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-84bd2150-3122-4462-9827-05a100d166f3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:04.465940 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-84bd2150-3122-4462-9827-05a100d166f3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:04.474272 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-84bd2150-3122-4462-9827-05a100d166f3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:04.474717 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-84bd2150-3122-4462-9827-05a100d166f3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:04.475488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-84bd2150-3122-4462-9827-05a100d166f3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:04.475915 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-84bd2150-3122-4462-9827-05a100d166f3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:04.620429 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fe8cb09c-6f49-493a-8d97-6d3fcada4912 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:04.620998 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fe8cb09c-6f49-493a-8d97-6d3fcada4912 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:04.624405 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-84bd2150-3122-4462-9827-05a100d166f3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:04.628615 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fe8cb09c-6f49-493a-8d97-6d3fcada4912 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:04.629081 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fe8cb09c-6f49-493a-8d97-6d3fcada4912 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:04.629870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fe8cb09c-6f49-493a-8d97-6d3fcada4912 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:04.630299 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-fe8cb09c-6f49-493a-8d97-6d3fcada4912 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:04.632557 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-84bd2150-3122-4462-9827-05a100d166f3 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1314 microversion: 2.1 time: 0.173784 Dec 13 16:56:04.633351 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 447/889] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:04 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:04.657706 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-fe8cb09c-6f49-493a-8d97-6d3fcada4912 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:56:04.729034 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f7dd2611-b352-4588-b69b-cd8eada876cc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:04.729781 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f7dd2611-b352-4588-b69b-cd8eada876cc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:04.736270 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f7dd2611-b352-4588-b69b-cd8eada876cc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:04.736923 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f7dd2611-b352-4588-b69b-cd8eada876cc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:04.737749 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f7dd2611-b352-4588-b69b-cd8eada876cc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:04.738398 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f7dd2611-b352-4588-b69b-cd8eada876cc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:04.742644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fe8cb09c-6f49-493a-8d97-6d3fcada4912 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "DELETE /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 204 len: 0 microversion: 2.1 time: 0.125663 Dec 13 16:56:04.743462 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 443/890] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:56:04 2021] DELETE /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:56:04.752463 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-dc9ec8ca-122a-45b9-a1a9-ca3256f8e357 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:04.753196 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-dc9ec8ca-122a-45b9-a1a9-ca3256f8e357 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:04.759108 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dc9ec8ca-122a-45b9-a1a9-ca3256f8e357 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:04.759554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dc9ec8ca-122a-45b9-a1a9-ca3256f8e357 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:04.760354 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dc9ec8ca-122a-45b9-a1a9-ca3256f8e357 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:04.760810 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-dc9ec8ca-122a-45b9-a1a9-ca3256f8e357 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:04.891082 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f7dd2611-b352-4588-b69b-cd8eada876cc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:04.899155 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f7dd2611-b352-4588-b69b-cd8eada876cc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.173958 Dec 13 16:56:04.899956 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 448/891] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:04 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:04.900124 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-dc9ec8ca-122a-45b9-a1a9-ca3256f8e357 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:04.909301 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-dc9ec8ca-122a-45b9-a1a9-ca3256f8e357 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1515 microversion: 2.1 time: 0.161441 Dec 13 16:56:04.909917 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 444/892] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:04 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:05.650821 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-20259137-4bf4-4910-8cb3-e25369b60a4f tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:05.651480 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-20259137-4bf4-4910-8cb3-e25369b60a4f tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:05.659135 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-20259137-4bf4-4910-8cb3-e25369b60a4f tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:05.659774 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-20259137-4bf4-4910-8cb3-e25369b60a4f tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:05.660917 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-20259137-4bf4-4910-8cb3-e25369b60a4f tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:05.661529 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-20259137-4bf4-4910-8cb3-e25369b60a4f tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:05.806527 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-20259137-4bf4-4910-8cb3-e25369b60a4f tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:05.825779 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-20259137-4bf4-4910-8cb3-e25369b60a4f tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1314 microversion: 2.1 time: 0.179227 Dec 13 16:56:05.826817 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 449/893] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:05 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:05.924629 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4b56d5b4-5379-4066-b663-462291114cb9 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:05.925697 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4b56d5b4-5379-4066-b663-462291114cb9 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:05.931539 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-356337ae-fdad-4cdd-9f9b-830e421f605f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:05.932321 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4b56d5b4-5379-4066-b663-462291114cb9 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:05.932683 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-356337ae-fdad-4cdd-9f9b-830e421f605f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:05.932792 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4b56d5b4-5379-4066-b663-462291114cb9 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:05.933561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4b56d5b4-5379-4066-b663-462291114cb9 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:05.933988 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4b56d5b4-5379-4066-b663-462291114cb9 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:05.940122 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-356337ae-fdad-4cdd-9f9b-830e421f605f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:05.940664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-356337ae-fdad-4cdd-9f9b-830e421f605f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:05.941549 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-356337ae-fdad-4cdd-9f9b-830e421f605f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:05.941976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-356337ae-fdad-4cdd-9f9b-830e421f605f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:06.075064 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4b56d5b4-5379-4066-b663-462291114cb9 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:06.075234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-356337ae-fdad-4cdd-9f9b-830e421f605f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:06.083178 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4b56d5b4-5379-4066-b663-462291114cb9 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.167973 Dec 13 16:56:06.083509 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-356337ae-fdad-4cdd-9f9b-830e421f605f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1515 microversion: 2.1 time: 0.159515 Dec 13 16:56:06.083868 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 445/894] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:05 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:06.084622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 450/895] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:05 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:06.792916 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-ef35b8a0-730a-48bc-a5b5-171bc10722de req-34c0cf44-969b-4c3d-af39-8d52106a4e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480dcd5e-4e36-4139-bd52-df57f36d3ba6", "name": "network-vif-deleted", "tag": "6e87af8a-2f15-4d0b-b805-697a5ab064b5"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:06.794635 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:06.794635 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:56:06.801996 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-ef35b8a0-730a-48bc-a5b5-171bc10722de req-34c0cf44-969b-4c3d-af39-8d52106a4e90 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:06.802610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-ef35b8a0-730a-48bc-a5b5-171bc10722de req-34c0cf44-969b-4c3d-af39-8d52106a4e90 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:06.814183 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-ef35b8a0-730a-48bc-a5b5-171bc10722de req-34c0cf44-969b-4c3d-af39-8d52106a4e90 service nova] Creating event network-vif-deleted:6e87af8a-2f15-4d0b-b805-697a5ab064b5 for instance 480dcd5e-4e36-4139-bd52-df57f36d3ba6 on hv-cinder-82160 Dec 13 16:56:06.819961 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-ef35b8a0-730a-48bc-a5b5-171bc10722de req-34c0cf44-969b-4c3d-af39-8d52106a4e90 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030863 Dec 13 16:56:06.820682 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 446/896] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:56:06.844100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1614fe37-ecac-41a3-af84-ce09889249fe tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:06.844740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1614fe37-ecac-41a3-af84-ce09889249fe tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:06.851415 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1614fe37-ecac-41a3-af84-ce09889249fe tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:06.851856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1614fe37-ecac-41a3-af84-ce09889249fe tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:06.852662 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1614fe37-ecac-41a3-af84-ce09889249fe tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:06.853083 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1614fe37-ecac-41a3-af84-ce09889249fe tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:06.992249 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1614fe37-ecac-41a3-af84-ce09889249fe tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:06.999878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1614fe37-ecac-41a3-af84-ce09889249fe tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1314 microversion: 2.1 time: 0.160119 Dec 13 16:56:07.000478 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 451/897] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:06 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:07.102343 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:07.103789 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:07.110613 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:07.111058 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:07.111457 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2f325155-fd0c-4231-97fb-2a86d1748076 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:07.111872 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:07.112047 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-2f325155-fd0c-4231-97fb-2a86d1748076 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:07.112244 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:07.119016 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2f325155-fd0c-4231-97fb-2a86d1748076 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:07.119491 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2f325155-fd0c-4231-97fb-2a86d1748076 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:07.120276 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2f325155-fd0c-4231-97fb-2a86d1748076 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:07.120741 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2f325155-fd0c-4231-97fb-2a86d1748076 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:07.144412 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:07.144870 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:07.145498 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lazy-loading 'fault' on Instance uuid 480dcd5e-4e36-4139-bd52-df57f36d3ba6 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:56:07.195078 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:07.205734 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-63eb6700-090d-4128-a71f-754f1c7315c8 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 200 len: 1308 microversion: 2.1 time: 0.108182 Dec 13 16:56:07.206730 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 447/898] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:07 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:07.213124 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-3a2b1859-78b4-482e-9fd3-063ef08a1729 req-ffb86182-5d68-44bf-8680-8bd5f366916f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277", "name": "network-vif-plugged", "status": "completed", "tag": "13b338b1-08ca-43cf-9332-977c23a3e08b"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:07.214889 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:07.214889 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:56:07.222905 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-3a2b1859-78b4-482e-9fd3-063ef08a1729 req-ffb86182-5d68-44bf-8680-8bd5f366916f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:07.223439 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-3a2b1859-78b4-482e-9fd3-063ef08a1729 req-ffb86182-5d68-44bf-8680-8bd5f366916f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:07.237150 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-3a2b1859-78b4-482e-9fd3-063ef08a1729 req-ffb86182-5d68-44bf-8680-8bd5f366916f service nova] Creating event network-vif-plugged:13b338b1-08ca-43cf-9332-977c23a3e08b for instance 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 on hv-cinder-82160 Dec 13 16:56:07.243089 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-3a2b1859-78b4-482e-9fd3-063ef08a1729 req-ffb86182-5d68-44bf-8680-8bd5f366916f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Dec 13 16:56:07.244490 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 448/899] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:56:07.281018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-2f325155-fd0c-4231-97fb-2a86d1748076 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:07.289427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2f325155-fd0c-4231-97fb-2a86d1748076 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.181590 Dec 13 16:56:07.290001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 452/900] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:07 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:08.020152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-41553feb-0cd5-4e5e-8120-e8a9d9f2b01e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:08.020991 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-41553feb-0cd5-4e5e-8120-e8a9d9f2b01e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:08.028924 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-41553feb-0cd5-4e5e-8120-e8a9d9f2b01e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.029452 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-41553feb-0cd5-4e5e-8120-e8a9d9f2b01e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.030365 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-41553feb-0cd5-4e5e-8120-e8a9d9f2b01e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.030876 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-41553feb-0cd5-4e5e-8120-e8a9d9f2b01e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.182278 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-41553feb-0cd5-4e5e-8120-e8a9d9f2b01e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:08.192503 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-41553feb-0cd5-4e5e-8120-e8a9d9f2b01e tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1314 microversion: 2.1 time: 0.178657 Dec 13 16:56:08.193093 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 449/901] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:08 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:08.223484 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:08.224502 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: 480dcd5e-4e36-4139-bd52-df57f36d3ba6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:08.234421 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.235085 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.236253 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.236815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.255778 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] HTTP exception thrown: Instance 480dcd5e-4e36-4139-bd52-df57f36d3ba6 could not be found. Dec 13 16:56:08.256353 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Returning 404 to user: Instance 480dcd5e-4e36-4139-bd52-df57f36d3ba6 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:56:08.257236 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ee5f323a-0023-40ec-a655-aa5b705ab002 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6" status: 404 len: 111 microversion: 2.1 time: 0.037735 Dec 13 16:56:08.257766 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 453/902] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:08 2021] GET /compute/v2.1/servers/480dcd5e-4e36-4139-bd52-df57f36d3ba6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:56:08.265871 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-0ea5e156-9266-4fc7-a67c-43dcf890cb15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:08.266357 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0ea5e156-9266-4fc7-a67c-43dcf890cb15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:08.272796 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0ea5e156-9266-4fc7-a67c-43dcf890cb15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.273171 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0ea5e156-9266-4fc7-a67c-43dcf890cb15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.273931 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0ea5e156-9266-4fc7-a67c-43dcf890cb15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.274352 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-0ea5e156-9266-4fc7-a67c-43dcf890cb15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.302624 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-0ea5e156-9266-4fc7-a67c-43dcf890cb15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:56:08.306084 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-81f4dda0-43fe-4b0a-8abf-971e04aaa08a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:08.306808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-81f4dda0-43fe-4b0a-8abf-971e04aaa08a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:08.312854 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-81f4dda0-43fe-4b0a-8abf-971e04aaa08a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.313296 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-81f4dda0-43fe-4b0a-8abf-971e04aaa08a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.314061 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-81f4dda0-43fe-4b0a-8abf-971e04aaa08a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.314508 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-81f4dda0-43fe-4b0a-8abf-971e04aaa08a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.386533 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-0ea5e156-9266-4fc7-a67c-43dcf890cb15 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 204 len: 0 microversion: 2.1 time: 0.123930 Dec 13 16:56:08.387345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 450/903] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:56:08 2021] DELETE /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:56:08.396317 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4f1a582e-29cc-434f-97f6-99d6aaab5613 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:08.396977 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4f1a582e-29cc-434f-97f6-99d6aaab5613 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:08.403028 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f1a582e-29cc-434f-97f6-99d6aaab5613 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.403465 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f1a582e-29cc-434f-97f6-99d6aaab5613 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.404282 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f1a582e-29cc-434f-97f6-99d6aaab5613 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:08.404715 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f1a582e-29cc-434f-97f6-99d6aaab5613 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:08.453242 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-81f4dda0-43fe-4b0a-8abf-971e04aaa08a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:08.462428 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-81f4dda0-43fe-4b0a-8abf-971e04aaa08a tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.159905 Dec 13 16:56:08.463792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 454/904] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:08 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:08.547334 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4f1a582e-29cc-434f-97f6-99d6aaab5613 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:08.555176 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4f1a582e-29cc-434f-97f6-99d6aaab5613 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1513 microversion: 2.1 time: 0.163405 Dec 13 16:56:08.555758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 451/905] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:08 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:09.213557 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b236a4a0-ca7f-4063-8b25-8c5582cdb7fa tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:09.214544 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b236a4a0-ca7f-4063-8b25-8c5582cdb7fa tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:09.224467 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b236a4a0-ca7f-4063-8b25-8c5582cdb7fa tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:09.225114 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b236a4a0-ca7f-4063-8b25-8c5582cdb7fa tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:09.225706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b236a4a0-ca7f-4063-8b25-8c5582cdb7fa tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:09.226125 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b236a4a0-ca7f-4063-8b25-8c5582cdb7fa tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:09.382687 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b236a4a0-ca7f-4063-8b25-8c5582cdb7fa tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:09.394633 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b236a4a0-ca7f-4063-8b25-8c5582cdb7fa tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1498 microversion: 2.1 time: 0.187580 Dec 13 16:56:09.395223 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 455/906] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:09 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:09.483729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-15cfafc2-84a9-4e62-84ea-dc95c5581834 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:09.484613 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-15cfafc2-84a9-4e62-84ea-dc95c5581834 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:09.492074 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-15cfafc2-84a9-4e62-84ea-dc95c5581834 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:09.492523 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-15cfafc2-84a9-4e62-84ea-dc95c5581834 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:09.493325 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-15cfafc2-84a9-4e62-84ea-dc95c5581834 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:09.493749 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-15cfafc2-84a9-4e62-84ea-dc95c5581834 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:09.572921 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6ac7420a-2c1f-4e62-93d2-d90e56486c00 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:09.573758 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6ac7420a-2c1f-4e62-93d2-d90e56486c00 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:09.579870 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6ac7420a-2c1f-4e62-93d2-d90e56486c00 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:09.580316 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6ac7420a-2c1f-4e62-93d2-d90e56486c00 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:09.581294 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6ac7420a-2c1f-4e62-93d2-d90e56486c00 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:09.582249 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6ac7420a-2c1f-4e62-93d2-d90e56486c00 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:09.661292 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-15cfafc2-84a9-4e62-84ea-dc95c5581834 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:09.671023 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-15cfafc2-84a9-4e62-84ea-dc95c5581834 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.193780 Dec 13 16:56:09.671612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 452/907] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:09 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:09.730056 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6ac7420a-2c1f-4e62-93d2-d90e56486c00 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:09.738768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6ac7420a-2c1f-4e62-93d2-d90e56486c00 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1513 microversion: 2.1 time: 0.169818 Dec 13 16:56:09.739289 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 456/908] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:09 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:09.878972 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f4bda813-ec8b-4d75-83b7-b8c0cfc05608 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:09.879820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f4bda813-ec8b-4d75-83b7-b8c0cfc05608 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:09.886221 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4bda813-ec8b-4d75-83b7-b8c0cfc05608 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:09.886663 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4bda813-ec8b-4d75-83b7-b8c0cfc05608 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:09.887519 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4bda813-ec8b-4d75-83b7-b8c0cfc05608 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:09.888048 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f4bda813-ec8b-4d75-83b7-b8c0cfc05608 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:09.913378 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f4bda813-ec8b-4d75-83b7-b8c0cfc05608 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Going to try to terminate instance {{(pid=122885) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:56:09.994059 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f4bda813-ec8b-4d75-83b7-b8c0cfc05608 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 204 len: 0 microversion: 2.1 time: 0.118407 Dec 13 16:56:09.994937 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 453/909] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:56:09 2021] DELETE /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:56:10.003207 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-62bde45a-9c2a-4da4-95bc-583c4c6022f5 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:10.003878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-62bde45a-9c2a-4da4-95bc-583c4c6022f5 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:10.010126 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-62bde45a-9c2a-4da4-95bc-583c4c6022f5 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:10.010648 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-62bde45a-9c2a-4da4-95bc-583c4c6022f5 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:10.011641 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-62bde45a-9c2a-4da4-95bc-583c4c6022f5 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:10.012070 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-62bde45a-9c2a-4da4-95bc-583c4c6022f5 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:10.240977 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-62bde45a-9c2a-4da4-95bc-583c4c6022f5 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:10.249510 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-62bde45a-9c2a-4da4-95bc-583c4c6022f5 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1504 microversion: 2.1 time: 0.250000 Dec 13 16:56:10.250015 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 457/910] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:09 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:10.328690 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-dd253e18-747a-4916-8522-3197d9b4dc40 req-47b50c9b-03fa-4579-9db0-70877c5ca6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0550d1c-5c78-4f91-b4be-b55d993fee22", "name": "network-vif-deleted", "tag": "6e8afb44-d87a-422c-bcae-a93462369a7d"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:10.330221 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:10.330221 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:56:10.337780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-dd253e18-747a-4916-8522-3197d9b4dc40 req-47b50c9b-03fa-4579-9db0-70877c5ca6c1 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:10.338291 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-dd253e18-747a-4916-8522-3197d9b4dc40 req-47b50c9b-03fa-4579-9db0-70877c5ca6c1 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:10.350027 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-dd253e18-747a-4916-8522-3197d9b4dc40 req-47b50c9b-03fa-4579-9db0-70877c5ca6c1 service nova] Creating event network-vif-deleted:6e8afb44-d87a-422c-bcae-a93462369a7d for instance b0550d1c-5c78-4f91-b4be-b55d993fee22 on hv-cinder-82160 Dec 13 16:56:10.355038 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-dd253e18-747a-4916-8522-3197d9b4dc40 req-47b50c9b-03fa-4579-9db0-70877c5ca6c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030329 Dec 13 16:56:10.356002 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 454/911] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:56:10.688863 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c7642100-da2b-4b9b-b723-3624a9217d9b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:10.689478 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c7642100-da2b-4b9b-b723-3624a9217d9b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:10.696445 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c7642100-da2b-4b9b-b723-3624a9217d9b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:10.696897 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c7642100-da2b-4b9b-b723-3624a9217d9b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:10.697680 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c7642100-da2b-4b9b-b723-3624a9217d9b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:10.698100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c7642100-da2b-4b9b-b723-3624a9217d9b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:10.757151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:10.758011 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:10.764732 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:10.765412 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:10.766198 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:10.766624 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:10.804342 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:10.805048 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:10.805591 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lazy-loading 'fault' on Instance uuid b0550d1c-5c78-4f91-b4be-b55d993fee22 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:56:10.845941 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c7642100-da2b-4b9b-b723-3624a9217d9b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:10.846976 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:10.854169 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-7ae92f7f-9f9c-4810-9be8-c13cbcaab59a tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 200 len: 1307 microversion: 2.1 time: 0.102316 Dec 13 16:56:10.855062 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 455/912] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:10 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:10.856029 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c7642100-da2b-4b9b-b723-3624a9217d9b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.170644 Dec 13 16:56:10.859803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 458/913] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:10 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:11.270136 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ccad4d4f-2982-4d59-8522-2f5dbc289261 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:11.271306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ccad4d4f-2982-4d59-8522-2f5dbc289261 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:11.281542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ccad4d4f-2982-4d59-8522-2f5dbc289261 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:11.282289 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ccad4d4f-2982-4d59-8522-2f5dbc289261 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:11.283965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ccad4d4f-2982-4d59-8522-2f5dbc289261 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:11.284663 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ccad4d4f-2982-4d59-8522-2f5dbc289261 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:11.424182 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ccad4d4f-2982-4d59-8522-2f5dbc289261 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8501035d3f3c4a46a05b72b8234befac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2c012e0f9a44258850f7026e65a6ec2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:11.432675 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ccad4d4f-2982-4d59-8522-2f5dbc289261 tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 200 len: 1504 microversion: 2.1 time: 0.168278 Dec 13 16:56:11.433497 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 456/914] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:11 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:11.874543 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:11.875137 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8aafc6a4-bf4f-46ea-a2f9-ad07efe5028c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:11.875513 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: b0550d1c-5c78-4f91-b4be-b55d993fee22] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:11.876255 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8aafc6a4-bf4f-46ea-a2f9-ad07efe5028c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:11.882274 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:11.882719 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:11.886721 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8aafc6a4-bf4f-46ea-a2f9-ad07efe5028c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:11.887166 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8aafc6a4-bf4f-46ea-a2f9-ad07efe5028c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:11.887947 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8aafc6a4-bf4f-46ea-a2f9-ad07efe5028c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:11.888371 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8aafc6a4-bf4f-46ea-a2f9-ad07efe5028c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:11.889288 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:11.889733 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:11.907160 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] HTTP exception thrown: Instance b0550d1c-5c78-4f91-b4be-b55d993fee22 could not be found. Dec 13 16:56:11.907751 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Returning 404 to user: Instance b0550d1c-5c78-4f91-b4be-b55d993fee22 could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:56:11.909239 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-14f1dd71-681f-426c-931f-40a3cc5dc543 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22" status: 404 len: 111 microversion: 2.1 time: 0.040104 Dec 13 16:56:11.910424 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 459/915] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:11 2021] GET /compute/v2.1/servers/b0550d1c-5c78-4f91-b4be-b55d993fee22 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:56:12.051340 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8aafc6a4-bf4f-46ea-a2f9-ad07efe5028c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:12.059170 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8aafc6a4-bf4f-46ea-a2f9-ad07efe5028c tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.189422 Dec 13 16:56:12.059741 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 457/916] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:11 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:12.371363 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-44b4d33b-b239-43af-8056-88d07b4dd7db req-87429e63-8be8-4d7f-847c-eed738968497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277", "name": "network-vif-deleted", "tag": "13b338b1-08ca-43cf-9332-977c23a3e08b"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:12.372967 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:12.372967 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:56:12.381560 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-44b4d33b-b239-43af-8056-88d07b4dd7db req-87429e63-8be8-4d7f-847c-eed738968497 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:12.382001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-44b4d33b-b239-43af-8056-88d07b4dd7db req-87429e63-8be8-4d7f-847c-eed738968497 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:12.393491 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-44b4d33b-b239-43af-8056-88d07b4dd7db req-87429e63-8be8-4d7f-847c-eed738968497 service nova] Creating event network-vif-deleted:13b338b1-08ca-43cf-9332-977c23a3e08b for instance 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 on hv-cinder-82160 Dec 13 16:56:12.399637 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-44b4d33b-b239-43af-8056-88d07b4dd7db req-87429e63-8be8-4d7f-847c-eed738968497 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031928 Dec 13 16:56:12.400232 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 460/917] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:56:12.450572 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:12.451183 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] [instance: 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:12.457643 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:12.458146 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:12.458925 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:12.459349 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:12.473230 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] HTTP exception thrown: Instance 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 could not be found. Dec 13 16:56:12.473836 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] Returning 404 to user: Instance 7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:56:12.474652 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4f58b902-4d9a-4bbc-9b28-0b2339bbd81b tempest-VolumesActionsTest-235290729 tempest-VolumesActionsTest-235290729-project] 10.222.0.62 "GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277" status: 404 len: 111 microversion: 2.1 time: 0.028191 Dec 13 16:56:12.475259 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 458/918] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:12 2021] GET /compute/v2.1/servers/7b8ef1ed-ac13-4600-9d7a-a04fcd9e5277 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:56:13.051719 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-352a656e-2546-4e14-b682-07d3a9fb8dab tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:13.052359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-352a656e-2546-4e14-b682-07d3a9fb8dab tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:13.059184 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-352a656e-2546-4e14-b682-07d3a9fb8dab tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:13.059900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-352a656e-2546-4e14-b682-07d3a9fb8dab tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:13.060803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-352a656e-2546-4e14-b682-07d3a9fb8dab tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:13.061248 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-352a656e-2546-4e14-b682-07d3a9fb8dab tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:13.077043 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cf2aef0a-36b3-454d-bc07-bdfa938aa2b3 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:13.078242 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cf2aef0a-36b3-454d-bc07-bdfa938aa2b3 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:13.086166 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf2aef0a-36b3-454d-bc07-bdfa938aa2b3 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:13.086616 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf2aef0a-36b3-454d-bc07-bdfa938aa2b3 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:13.087405 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf2aef0a-36b3-454d-bc07-bdfa938aa2b3 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:13.087833 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cf2aef0a-36b3-454d-bc07-bdfa938aa2b3 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:13.088160 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-352a656e-2546-4e14-b682-07d3a9fb8dab tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:56:13.195102 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-352a656e-2546-4e14-b682-07d3a9fb8dab tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 204 len: 0 microversion: 2.1 time: 0.145125 Dec 13 16:56:13.196768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 461/919] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:56:13 2021] DELETE /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:56:13.202461 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ba27b4a5-88d9-4aa3-bb91-418cf545b38f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:13.203386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ba27b4a5-88d9-4aa3-bb91-418cf545b38f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:13.210067 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ba27b4a5-88d9-4aa3-bb91-418cf545b38f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:13.210790 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ba27b4a5-88d9-4aa3-bb91-418cf545b38f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:13.211594 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ba27b4a5-88d9-4aa3-bb91-418cf545b38f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:13.212028 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ba27b4a5-88d9-4aa3-bb91-418cf545b38f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:13.244859 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cf2aef0a-36b3-454d-bc07-bdfa938aa2b3 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:13.252883 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cf2aef0a-36b3-454d-bc07-bdfa938aa2b3 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.179473 Dec 13 16:56:13.259841 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 459/920] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:13 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:13.350026 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ba27b4a5-88d9-4aa3-bb91-418cf545b38f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:13.358686 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ba27b4a5-88d9-4aa3-bb91-418cf545b38f tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1513 microversion: 2.1 time: 0.160757 Dec 13 16:56:13.359270 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 462/921] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:13 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:14.270403 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-596d8520-098f-43e0-8da2-a1e8d626832b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:14.271263 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-596d8520-098f-43e0-8da2-a1e8d626832b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:14.278019 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-596d8520-098f-43e0-8da2-a1e8d626832b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:14.278461 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-596d8520-098f-43e0-8da2-a1e8d626832b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:14.279225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-596d8520-098f-43e0-8da2-a1e8d626832b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:14.279647 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-596d8520-098f-43e0-8da2-a1e8d626832b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:14.376846 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7b203d56-d48d-44d9-a557-34c0a85fd504 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:14.377639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7b203d56-d48d-44d9-a557-34c0a85fd504 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:14.384269 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7b203d56-d48d-44d9-a557-34c0a85fd504 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:14.384751 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7b203d56-d48d-44d9-a557-34c0a85fd504 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:14.385527 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7b203d56-d48d-44d9-a557-34c0a85fd504 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:14.385955 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7b203d56-d48d-44d9-a557-34c0a85fd504 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:14.418409 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-596d8520-098f-43e0-8da2-a1e8d626832b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:14.426032 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-596d8520-098f-43e0-8da2-a1e8d626832b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.159482 Dec 13 16:56:14.426601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 460/922] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:14 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:14.520196 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7b203d56-d48d-44d9-a557-34c0a85fd504 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:14.528371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7b203d56-d48d-44d9-a557-34c0a85fd504 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1513 microversion: 2.1 time: 0.155236 Dec 13 16:56:14.529044 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 463/923] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:14 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:15.446470 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-89d65b7f-e143-4c8d-8d2a-780974d53217 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:15.447224 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-89d65b7f-e143-4c8d-8d2a-780974d53217 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:15.456198 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-89d65b7f-e143-4c8d-8d2a-780974d53217 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:15.456876 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-89d65b7f-e143-4c8d-8d2a-780974d53217 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:15.457923 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-89d65b7f-e143-4c8d-8d2a-780974d53217 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:15.458507 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-89d65b7f-e143-4c8d-8d2a-780974d53217 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:15.546052 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-4d8a7c27-0841-4c0b-a0f6-53981ef55b85 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:15.546643 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-4d8a7c27-0841-4c0b-a0f6-53981ef55b85 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:15.553384 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c27-0841-4c0b-a0f6-53981ef55b85 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:15.553810 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c27-0841-4c0b-a0f6-53981ef55b85 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:15.554637 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c27-0841-4c0b-a0f6-53981ef55b85 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:15.555072 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c27-0841-4c0b-a0f6-53981ef55b85 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:15.697290 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-4d8a7c27-0841-4c0b-a0f6-53981ef55b85 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:15.706010 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-4d8a7c27-0841-4c0b-a0f6-53981ef55b85 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1513 microversion: 2.1 time: 0.163770 Dec 13 16:56:15.706704 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 464/924] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:15 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:15.858931 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-89d65b7f-e143-4c8d-8d2a-780974d53217 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:15.866483 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-89d65b7f-e143-4c8d-8d2a-780974d53217 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.426200 Dec 13 16:56:15.867086 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 461/925] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:15 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:16.723767 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-271b465e-fa8d-44b3-8869-322b669bf13b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:16.725137 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-271b465e-fa8d-44b3-8869-322b669bf13b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:16.731935 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-271b465e-fa8d-44b3-8869-322b669bf13b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:16.732452 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-271b465e-fa8d-44b3-8869-322b669bf13b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:16.733373 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-271b465e-fa8d-44b3-8869-322b669bf13b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:16.733868 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-271b465e-fa8d-44b3-8869-322b669bf13b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:16.877325 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-271b465e-fa8d-44b3-8869-322b669bf13b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:16.886851 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-271b465e-fa8d-44b3-8869-322b669bf13b tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1513 microversion: 2.1 time: 0.166644 Dec 13 16:56:16.896986 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 465/926] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:16 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:16.897095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d6625bf1-a7ab-47a2-9210-8158d1ac69a5 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:16.897095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d6625bf1-a7ab-47a2-9210-8158d1ac69a5 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:16.897095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d6625bf1-a7ab-47a2-9210-8158d1ac69a5 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:16.897095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d6625bf1-a7ab-47a2-9210-8158d1ac69a5 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:16.898442 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d6625bf1-a7ab-47a2-9210-8158d1ac69a5 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:16.898876 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d6625bf1-a7ab-47a2-9210-8158d1ac69a5 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:17.053398 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d6625bf1-a7ab-47a2-9210-8158d1ac69a5 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:17.060966 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d6625bf1-a7ab-47a2-9210-8158d1ac69a5 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.176419 Dec 13 16:56:17.061541 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 462/927] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:16 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:17.842985 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-fa75da67-0e9d-4634-b8eb-7ed749fcafbf req-ab5edd5b-596d-4425-a67a-7a4827c7e78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5af783e-db46-4b24-892e-598e120cd9bf", "name": "network-vif-deleted", "tag": "dc82648a-ba50-4acf-b164-725387a2d87d"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:17.845639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:17.845639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:56:17.857837 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-fa75da67-0e9d-4634-b8eb-7ed749fcafbf req-ab5edd5b-596d-4425-a67a-7a4827c7e78f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:17.858628 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-fa75da67-0e9d-4634-b8eb-7ed749fcafbf req-ab5edd5b-596d-4425-a67a-7a4827c7e78f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:17.873930 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-fa75da67-0e9d-4634-b8eb-7ed749fcafbf req-ab5edd5b-596d-4425-a67a-7a4827c7e78f service nova] Creating event network-vif-deleted:dc82648a-ba50-4acf-b164-725387a2d87d for instance e5af783e-db46-4b24-892e-598e120cd9bf on hv-cinder-82160 Dec 13 16:56:17.880417 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-fa75da67-0e9d-4634-b8eb-7ed749fcafbf req-ab5edd5b-596d-4425-a67a-7a4827c7e78f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041411 Dec 13 16:56:17.881982 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 466/928] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:56:17.905261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:17.906592 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:17.915665 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:17.916945 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:17.920331 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:17.921561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:17.966297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:17.967008 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:17.967731 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lazy-loading 'fault' on Instance uuid e5af783e-db46-4b24-892e-598e120cd9bf {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:56:18.015972 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431688bdedc6443cb3718b6af3cdcc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1af29ea9c44a7870cae601abfe353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:18.024629 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f3632d32-5426-45ef-b673-5281a74eb05c tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 200 len: 1307 microversion: 2.1 time: 0.122928 Dec 13 16:56:18.025628 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 463/929] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:17 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:18.079545 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7b374db2-1ed7-452b-aaa7-a2486f0abf85 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:18.080681 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7b374db2-1ed7-452b-aaa7-a2486f0abf85 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:18.089581 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7b374db2-1ed7-452b-aaa7-a2486f0abf85 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:18.090074 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7b374db2-1ed7-452b-aaa7-a2486f0abf85 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:18.090879 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7b374db2-1ed7-452b-aaa7-a2486f0abf85 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:18.091309 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7b374db2-1ed7-452b-aaa7-a2486f0abf85 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:18.256498 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7b374db2-1ed7-452b-aaa7-a2486f0abf85 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:18.269079 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7b374db2-1ed7-452b-aaa7-a2486f0abf85 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1507 microversion: 2.1 time: 0.193553 Dec 13 16:56:18.282214 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 467/930] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:18 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:18.288518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d767ef35-8201-410e-b804-f432d1cf540b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:18.289130 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d767ef35-8201-410e-b804-f432d1cf540b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:18.297303 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d767ef35-8201-410e-b804-f432d1cf540b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:18.298050 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d767ef35-8201-410e-b804-f432d1cf540b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:18.300439 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d767ef35-8201-410e-b804-f432d1cf540b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:18.301069 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d767ef35-8201-410e-b804-f432d1cf540b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:18.422418 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d767ef35-8201-410e-b804-f432d1cf540b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "POST /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6/action" status: 202 len: 0 microversion: 2.1 time: 0.138668 Dec 13 16:56:18.423311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 464/931] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:56:18 2021] POST /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:56:18.431835 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f894b9c0-069f-4270-963f-6e4e25541afc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:18.432448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f894b9c0-069f-4270-963f-6e4e25541afc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:18.442537 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f894b9c0-069f-4270-963f-6e4e25541afc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:18.446260 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f894b9c0-069f-4270-963f-6e4e25541afc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:18.447821 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f894b9c0-069f-4270-963f-6e4e25541afc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:18.448424 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f894b9c0-069f-4270-963f-6e4e25541afc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:18.673548 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f894b9c0-069f-4270-963f-6e4e25541afc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:18.684458 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f894b9c0-069f-4270-963f-6e4e25541afc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1515 microversion: 2.1 time: 0.256464 Dec 13 16:56:18.685445 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 468/932] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:18 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:19.045134 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:19.045807 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] [instance: e5af783e-db46-4b24-892e-598e120cd9bf] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:19.056951 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-6049540c-dd30-4767-9d9b-a288970c4914 req-745f5c2d-7bc5-41a2-b8b3-4d4431d68a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895f7640-e4b3-4cb0-9632-d99cef54dab6", "name": "network-vif-unplugged", "status": "completed", "tag": "7bfe5c97-83ad-4a06-b866-31455cbfdf29"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:19.057540 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:19.057835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:19.058628 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:19.059216 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:19.059931 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:19.059931 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:56:19.075999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-6049540c-dd30-4767-9d9b-a288970c4914 req-745f5c2d-7bc5-41a2-b8b3-4d4431d68a99 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:19.076678 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-6049540c-dd30-4767-9d9b-a288970c4914 req-745f5c2d-7bc5-41a2-b8b3-4d4431d68a99 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:19.091437 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.compute.server_external_events [req-6049540c-dd30-4767-9d9b-a288970c4914 req-745f5c2d-7bc5-41a2-b8b3-4d4431d68a99 service nova] Unable to find a host for instance 895f7640-e4b3-4cb0-9632-d99cef54dab6. Dropping event network-vif-unplugged {{(pid=122886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 13 16:56:19.091800 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] HTTP exception thrown: Instance e5af783e-db46-4b24-892e-598e120cd9bf could not be found. Dec 13 16:56:19.092333 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-6049540c-dd30-4767-9d9b-a288970c4914 req-745f5c2d-7bc5-41a2-b8b3-4d4431d68a99 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040624 Dec 13 16:56:19.092449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] Returning 404 to user: Instance e5af783e-db46-4b24-892e-598e120cd9bf could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:56:19.092959 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 469/933] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:19 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 13 16:56:19.096827 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-bf5bacd5-9680-4305-b401-f61c584241e1 tempest-AttachVolumeNegativeTest-163047425 tempest-AttachVolumeNegativeTest-163047425-project] 10.222.0.62 "GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf" status: 404 len: 111 microversion: 2.1 time: 0.054208 Dec 13 16:56:19.097947 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 465/934] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:19 2021] GET /compute/v2.1/servers/e5af783e-db46-4b24-892e-598e120cd9bf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:56:19.702942 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8ceffa7a-8212-4346-b0d1-20a6f8d19d63 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:19.703559 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8ceffa7a-8212-4346-b0d1-20a6f8d19d63 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:19.714066 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8ceffa7a-8212-4346-b0d1-20a6f8d19d63 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:19.714427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8ceffa7a-8212-4346-b0d1-20a6f8d19d63 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:19.715262 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8ceffa7a-8212-4346-b0d1-20a6f8d19d63 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:19.715699 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8ceffa7a-8212-4346-b0d1-20a6f8d19d63 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:19.942707 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8ceffa7a-8212-4346-b0d1-20a6f8d19d63 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:19.952587 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8ceffa7a-8212-4346-b0d1-20a6f8d19d63 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1517 microversion: 2.1 time: 0.254052 Dec 13 16:56:19.953510 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 470/935] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:19 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:56:20.971669 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6e9198ed-1e49-4b90-afd1-e765c6fbb8d4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:20.972897 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6e9198ed-1e49-4b90-afd1-e765c6fbb8d4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:20.981999 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6e9198ed-1e49-4b90-afd1-e765c6fbb8d4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:20.982753 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6e9198ed-1e49-4b90-afd1-e765c6fbb8d4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:20.983979 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6e9198ed-1e49-4b90-afd1-e765c6fbb8d4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:20.984778 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6e9198ed-1e49-4b90-afd1-e765c6fbb8d4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:21.161249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6e9198ed-1e49-4b90-afd1-e765c6fbb8d4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:21.177257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6e9198ed-1e49-4b90-afd1-e765c6fbb8d4 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1573 microversion: 2.1 time: 0.209313 Dec 13 16:56:21.179666 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 466/936] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:20 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1573 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:22.196131 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c3bcb64a-1d91-475e-9e3f-2a97d71208fc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:22.196929 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c3bcb64a-1d91-475e-9e3f-2a97d71208fc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:22.205421 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c3bcb64a-1d91-475e-9e3f-2a97d71208fc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:22.206225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c3bcb64a-1d91-475e-9e3f-2a97d71208fc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:22.207248 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c3bcb64a-1d91-475e-9e3f-2a97d71208fc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:22.208260 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c3bcb64a-1d91-475e-9e3f-2a97d71208fc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:22.400119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c3bcb64a-1d91-475e-9e3f-2a97d71208fc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:22.408900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c3bcb64a-1d91-475e-9e3f-2a97d71208fc tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1573 microversion: 2.1 time: 0.216994 Dec 13 16:56:22.409818 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 471/937] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:22 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1573 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:23.427926 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a0cf6afd-ffcf-4ee4-a619-685f37b54ebf tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:23.428614 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a0cf6afd-ffcf-4ee4-a619-685f37b54ebf tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:23.435620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a0cf6afd-ffcf-4ee4-a619-685f37b54ebf tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:23.436079 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a0cf6afd-ffcf-4ee4-a619-685f37b54ebf tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:23.436949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a0cf6afd-ffcf-4ee4-a619-685f37b54ebf tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:23.437390 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a0cf6afd-ffcf-4ee4-a619-685f37b54ebf tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:23.666206 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a0cf6afd-ffcf-4ee4-a619-685f37b54ebf tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:23.674449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a0cf6afd-ffcf-4ee4-a619-685f37b54ebf tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1573 microversion: 2.1 time: 0.250803 Dec 13 16:56:23.675061 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 467/938] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:23 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1573 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:24.698189 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-bfc0c897-d5cf-4a4e-a090-2c739b85b3e0 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:24.699250 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-bfc0c897-d5cf-4a4e-a090-2c739b85b3e0 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:24.719601 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfc0c897-d5cf-4a4e-a090-2c739b85b3e0 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:24.721709 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfc0c897-d5cf-4a4e-a090-2c739b85b3e0 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:24.725325 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfc0c897-d5cf-4a4e-a090-2c739b85b3e0 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:24.726644 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-bfc0c897-d5cf-4a4e-a090-2c739b85b3e0 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:24.913300 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-bfc0c897-d5cf-4a4e-a090-2c739b85b3e0 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:24.922607 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-bfc0c897-d5cf-4a4e-a090-2c739b85b3e0 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1573 microversion: 2.1 time: 0.229892 Dec 13 16:56:24.937670 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 472/939] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:24 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1573 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:25.944254 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-798a85ff-c834-4db1-a23d-df60459ebf1e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:25.945008 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-798a85ff-c834-4db1-a23d-df60459ebf1e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:25.953948 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-798a85ff-c834-4db1-a23d-df60459ebf1e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:25.954743 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-798a85ff-c834-4db1-a23d-df60459ebf1e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:25.955803 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-798a85ff-c834-4db1-a23d-df60459ebf1e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:25.956212 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-798a85ff-c834-4db1-a23d-df60459ebf1e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:26.119178 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-798a85ff-c834-4db1-a23d-df60459ebf1e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:26.127718 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-798a85ff-c834-4db1-a23d-df60459ebf1e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1573 microversion: 2.1 time: 0.187863 Dec 13 16:56:26.128302 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 468/940] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:25 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1573 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:27.156936 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-15c70ebe-6058-43f3-a4b4-eec74910209b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:27.158008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-15c70ebe-6058-43f3-a4b4-eec74910209b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:27.165583 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15c70ebe-6058-43f3-a4b4-eec74910209b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:27.166367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15c70ebe-6058-43f3-a4b4-eec74910209b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:27.167408 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15c70ebe-6058-43f3-a4b4-eec74910209b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:27.168206 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-15c70ebe-6058-43f3-a4b4-eec74910209b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:27.342720 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-15c70ebe-6058-43f3-a4b4-eec74910209b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:27.351687 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-15c70ebe-6058-43f3-a4b4-eec74910209b tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1573 microversion: 2.1 time: 0.201741 Dec 13 16:56:27.352876 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 473/941] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:27 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1573 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:28.371552 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-379bbb1e-aebc-4501-9b96-8294554db451 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:28.372832 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-379bbb1e-aebc-4501-9b96-8294554db451 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:28.380460 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-379bbb1e-aebc-4501-9b96-8294554db451 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:28.381235 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-379bbb1e-aebc-4501-9b96-8294554db451 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:28.382237 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-379bbb1e-aebc-4501-9b96-8294554db451 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:28.382830 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-379bbb1e-aebc-4501-9b96-8294554db451 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:28.529593 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-379bbb1e-aebc-4501-9b96-8294554db451 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:28.538073 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-379bbb1e-aebc-4501-9b96-8294554db451 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1573 microversion: 2.1 time: 0.170358 Dec 13 16:56:28.538885 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 469/942] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:28 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:29.145970 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-bf96c540-6583-419c-9975-1c658dfd7785 req-7152b0d9-e582-4fdb-8000-c6e995ef3c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895f7640-e4b3-4cb0-9632-d99cef54dab6", "name": "network-vif-plugged", "status": "completed", "tag": "7bfe5c97-83ad-4a06-b866-31455cbfdf29"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:29.147221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:56:29.147221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:56:29.159112 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-bf96c540-6583-419c-9975-1c658dfd7785 req-7152b0d9-e582-4fdb-8000-c6e995ef3c87 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:29.161143 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-bf96c540-6583-419c-9975-1c658dfd7785 req-7152b0d9-e582-4fdb-8000-c6e995ef3c87 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:29.188749 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-bf96c540-6583-419c-9975-1c658dfd7785 req-7152b0d9-e582-4fdb-8000-c6e995ef3c87 service nova] Creating event network-vif-plugged:7bfe5c97-83ad-4a06-b866-31455cbfdf29 for instance 895f7640-e4b3-4cb0-9632-d99cef54dab6 on hv-cinder-82160 Dec 13 16:56:29.207813 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-bf96c540-6583-419c-9975-1c658dfd7785 req-7152b0d9-e582-4fdb-8000-c6e995ef3c87 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065710 Dec 13 16:56:29.208726 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 474/943] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:56:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:56:29.556758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-9f87c89f-38fd-4e21-aa77-e9732c42fa6e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:29.558185 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-9f87c89f-38fd-4e21-aa77-e9732c42fa6e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:29.565239 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9f87c89f-38fd-4e21-aa77-e9732c42fa6e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:29.566074 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9f87c89f-38fd-4e21-aa77-e9732c42fa6e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:29.568107 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9f87c89f-38fd-4e21-aa77-e9732c42fa6e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:29.568545 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-9f87c89f-38fd-4e21-aa77-e9732c42fa6e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:29.731136 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-9f87c89f-38fd-4e21-aa77-e9732c42fa6e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:29.740703 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-9f87c89f-38fd-4e21-aa77-e9732c42fa6e tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1573 microversion: 2.1 time: 0.188059 Dec 13 16:56:29.741582 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 470/944] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:29 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:30.761191 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f51623ec-caa0-4ff2-8d48-6a51a28bcbb1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:30.761996 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f51623ec-caa0-4ff2-8d48-6a51a28bcbb1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:30.770278 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f51623ec-caa0-4ff2-8d48-6a51a28bcbb1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:30.771136 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f51623ec-caa0-4ff2-8d48-6a51a28bcbb1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:30.772256 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f51623ec-caa0-4ff2-8d48-6a51a28bcbb1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:30.773145 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f51623ec-caa0-4ff2-8d48-6a51a28bcbb1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:31.036430 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f51623ec-caa0-4ff2-8d48-6a51a28bcbb1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:31.044373 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f51623ec-caa0-4ff2-8d48-6a51a28bcbb1 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1560 microversion: 2.1 time: 0.287870 Dec 13 16:56:31.056623 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 475/945] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:30 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1560 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:57.700612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8536fceb-c44f-4aa3-9739-9dae8d952ef1 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Action: 'create', calling method: .version_select at 0x7f213bef04c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-67187315"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:57.714151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-8536fceb-c44f-4aa3-9739-9dae8d952ef1 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Getting quotas for project a17cfb32dc2b4830a07073b1bb4f821e. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:56:57.718225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-8536fceb-c44f-4aa3-9739-9dae8d952ef1 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Getting quotas for user 9305e888877a4b799a83a512007958ab and project a17cfb32dc2b4830a07073b1bb4f821e. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:56:57.873329 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-8536fceb-c44f-4aa3-9739-9dae8d952ef1 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Getting quotas for project a17cfb32dc2b4830a07073b1bb4f821e. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:56:57.877111 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-8536fceb-c44f-4aa3-9739-9dae8d952ef1 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Getting quotas for user 9305e888877a4b799a83a512007958ab and project a17cfb32dc2b4830a07073b1bb4f821e. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:56:57.890117 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8536fceb-c44f-4aa3-9739-9dae8d952ef1 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.193155 Dec 13 16:56:57.890722 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 471/946] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 13 16:56:57 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:57.988819 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2005676166", "imageRef": "3eb8d27d-2224-4db3-81b3-616e65ed484c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-67187315", "networks": [{"uuid": "1943af48-e3ff-441e-9a4a-321ca8d1be22"}]}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:56:58.039682 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] validate_networks() for [('1943af48-e3ff-441e-9a4a-321ca8d1be22', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:56:58.415477 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:56:58.415927 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:56:58.416674 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:56:58.417082 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:56:58.417494 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:56:58.426415 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:58.426861 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:58.427665 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:58.428096 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:58.446313 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Getting quotas for project a17cfb32dc2b4830a07073b1bb4f821e. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:56:58.450684 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Getting quotas for user 9305e888877a4b799a83a512007958ab and project a17cfb32dc2b4830a07073b1bb4f821e. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:56:58.462144 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:56:58.464448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3eb8d27d-2224-4db3-81b3-616e65ed484c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:56:58.518649 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-343217be-7736-47f5-b34e-787e43fc635d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533596 Dec 13 16:56:58.519592 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 476/947] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:56:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:56:58.529505 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cf0a1d19-e33e-4d85-87a1-62d190751a99 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:58.530133 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cf0a1d19-e33e-4d85-87a1-62d190751a99 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:58.599248 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cf0a1d19-e33e-4d85-87a1-62d190751a99 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:58.606975 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cf0a1d19-e33e-4d85-87a1-62d190751a99 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1257 microversion: 2.1 time: 0.081323 Dec 13 16:56:58.607542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 472/948] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:58 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1257 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:56:59.624076 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2fa1f149-98e2-4e30-918c-59edebc88ec0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:56:59.630745 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-2fa1f149-98e2-4e30-918c-59edebc88ec0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:56:59.642872 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2fa1f149-98e2-4e30-918c-59edebc88ec0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:59.643381 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2fa1f149-98e2-4e30-918c-59edebc88ec0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:59.644371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2fa1f149-98e2-4e30-918c-59edebc88ec0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:56:59.644933 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2fa1f149-98e2-4e30-918c-59edebc88ec0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:56:59.709706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-2fa1f149-98e2-4e30-918c-59edebc88ec0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:56:59.717851 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2fa1f149-98e2-4e30-918c-59edebc88ec0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1309 microversion: 2.1 time: 0.097564 Dec 13 16:56:59.718424 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 477/949] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:56:59 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:00.736476 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-bc56135d-e73e-4d8c-b9cc-dc833ed06537 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:00.744280 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-bc56135d-e73e-4d8c-b9cc-dc833ed06537 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:00.755763 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bc56135d-e73e-4d8c-b9cc-dc833ed06537 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:00.756186 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bc56135d-e73e-4d8c-b9cc-dc833ed06537 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:00.757848 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bc56135d-e73e-4d8c-b9cc-dc833ed06537 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:00.758542 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bc56135d-e73e-4d8c-b9cc-dc833ed06537 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:00.981063 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-bc56135d-e73e-4d8c-b9cc-dc833ed06537 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:00.990479 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-bc56135d-e73e-4d8c-b9cc-dc833ed06537 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.257598 Dec 13 16:57:00.991188 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 473/950] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:00 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:02.007705 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-669a5c65-004a-4487-94f7-74fb1d55e347 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:02.009120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-669a5c65-004a-4487-94f7-74fb1d55e347 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:02.015855 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-669a5c65-004a-4487-94f7-74fb1d55e347 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:02.016303 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-669a5c65-004a-4487-94f7-74fb1d55e347 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:02.017192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-669a5c65-004a-4487-94f7-74fb1d55e347 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:02.017620 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-669a5c65-004a-4487-94f7-74fb1d55e347 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:02.170776 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-669a5c65-004a-4487-94f7-74fb1d55e347 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:02.180975 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-669a5c65-004a-4487-94f7-74fb1d55e347 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.177035 Dec 13 16:57:02.181853 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 478/951] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:02 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:03.201128 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ce51ca07-0575-4878-b7fb-b64c43de2cdf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:03.202765 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ce51ca07-0575-4878-b7fb-b64c43de2cdf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:03.210417 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ce51ca07-0575-4878-b7fb-b64c43de2cdf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:03.211739 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ce51ca07-0575-4878-b7fb-b64c43de2cdf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:03.212858 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ce51ca07-0575-4878-b7fb-b64c43de2cdf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:03.213318 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ce51ca07-0575-4878-b7fb-b64c43de2cdf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:03.368148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ce51ca07-0575-4878-b7fb-b64c43de2cdf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:03.377397 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ce51ca07-0575-4878-b7fb-b64c43de2cdf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.183170 Dec 13 16:57:03.378562 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 474/952] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:03 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:04.395459 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-1f9e4b03-bfb4-4d31-a615-b14c44fb1f4a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:04.396337 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-1f9e4b03-bfb4-4d31-a615-b14c44fb1f4a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:04.403856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1f9e4b03-bfb4-4d31-a615-b14c44fb1f4a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:04.404302 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1f9e4b03-bfb4-4d31-a615-b14c44fb1f4a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:04.405359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1f9e4b03-bfb4-4d31-a615-b14c44fb1f4a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:04.405950 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-1f9e4b03-bfb4-4d31-a615-b14c44fb1f4a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:04.568270 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-1f9e4b03-bfb4-4d31-a615-b14c44fb1f4a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:04.577997 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-1f9e4b03-bfb4-4d31-a615-b14c44fb1f4a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.186355 Dec 13 16:57:04.579151 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 479/953] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:04 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:05.595287 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-20b1134f-80c2-4c15-a3e7-b50622d893a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:05.595921 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-20b1134f-80c2-4c15-a3e7-b50622d893a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:05.602889 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-20b1134f-80c2-4c15-a3e7-b50622d893a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:05.603670 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-20b1134f-80c2-4c15-a3e7-b50622d893a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:05.604458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-20b1134f-80c2-4c15-a3e7-b50622d893a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:05.604927 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-20b1134f-80c2-4c15-a3e7-b50622d893a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:05.772097 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-20b1134f-80c2-4c15-a3e7-b50622d893a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:05.790368 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-20b1134f-80c2-4c15-a3e7-b50622d893a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.197652 Dec 13 16:57:05.790368 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 475/954] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:05 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:06.810839 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a14bdd83-5860-4221-8c70-432462b25a2e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:06.811574 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a14bdd83-5860-4221-8c70-432462b25a2e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:06.818629 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a14bdd83-5860-4221-8c70-432462b25a2e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:06.819066 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a14bdd83-5860-4221-8c70-432462b25a2e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:06.820110 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a14bdd83-5860-4221-8c70-432462b25a2e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:06.820769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a14bdd83-5860-4221-8c70-432462b25a2e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:06.989319 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-a14bdd83-5860-4221-8c70-432462b25a2e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:06.997060 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a14bdd83-5860-4221-8c70-432462b25a2e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.194050 Dec 13 16:57:06.997630 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 480/955] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:06 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:08.018448 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-51a7b6e8-d57a-4897-8413-3325e63c921a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:08.019186 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-51a7b6e8-d57a-4897-8413-3325e63c921a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:08.031610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-51a7b6e8-d57a-4897-8413-3325e63c921a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:08.032035 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-51a7b6e8-d57a-4897-8413-3325e63c921a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:08.032854 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-51a7b6e8-d57a-4897-8413-3325e63c921a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:08.033280 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-51a7b6e8-d57a-4897-8413-3325e63c921a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:08.173272 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-51a7b6e8-d57a-4897-8413-3325e63c921a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:08.180982 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-51a7b6e8-d57a-4897-8413-3325e63c921a tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.170573 Dec 13 16:57:08.181533 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 476/956] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:08 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:09.200808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-56269171-c6da-42a2-9bf0-626a46e987f7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:09.201497 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-56269171-c6da-42a2-9bf0-626a46e987f7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:09.207518 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56269171-c6da-42a2-9bf0-626a46e987f7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:09.207955 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56269171-c6da-42a2-9bf0-626a46e987f7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:09.208750 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56269171-c6da-42a2-9bf0-626a46e987f7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:09.209179 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56269171-c6da-42a2-9bf0-626a46e987f7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:09.354329 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-56269171-c6da-42a2-9bf0-626a46e987f7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:09.366708 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-56269171-c6da-42a2-9bf0-626a46e987f7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.170195 Dec 13 16:57:09.367285 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 481/957] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:09 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:10.386646 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-df1fca59-5991-4d41-ab69-0904f19030ed tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:10.387452 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-df1fca59-5991-4d41-ab69-0904f19030ed tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:10.394104 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-df1fca59-5991-4d41-ab69-0904f19030ed tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:10.394808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-df1fca59-5991-4d41-ab69-0904f19030ed tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:10.395662 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-df1fca59-5991-4d41-ab69-0904f19030ed tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:10.396181 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-df1fca59-5991-4d41-ab69-0904f19030ed tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:10.546956 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-df1fca59-5991-4d41-ab69-0904f19030ed tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:10.555778 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-df1fca59-5991-4d41-ab69-0904f19030ed tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.173927 Dec 13 16:57:10.556786 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 477/958] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:10 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:11.581694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b96a2927-fcfb-46e4-ab0d-f25ade383dbf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:11.581694 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b96a2927-fcfb-46e4-ab0d-f25ade383dbf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:11.587046 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b96a2927-fcfb-46e4-ab0d-f25ade383dbf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:11.587488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b96a2927-fcfb-46e4-ab0d-f25ade383dbf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:11.588287 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b96a2927-fcfb-46e4-ab0d-f25ade383dbf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:11.588852 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b96a2927-fcfb-46e4-ab0d-f25ade383dbf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:11.805594 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b96a2927-fcfb-46e4-ab0d-f25ade383dbf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:11.814481 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b96a2927-fcfb-46e4-ab0d-f25ade383dbf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.239003 Dec 13 16:57:11.815173 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 482/959] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:11 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:11.875329 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-5db50fc6-d80d-41f9-9a2c-c0eb92ab91d5 req-56a1c32f-b604-4f57-81a8-6dca7578db61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d226a474-361b-42d6-921f-ae69afb7e5f0", "tag": "f2149286-95eb-4a07-a40a-b3f1eec2ba46"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:11.877130 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:57:11.877130 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:57:11.889597 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-5db50fc6-d80d-41f9-9a2c-c0eb92ab91d5 req-56a1c32f-b604-4f57-81a8-6dca7578db61 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:11.890043 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-5db50fc6-d80d-41f9-9a2c-c0eb92ab91d5 req-56a1c32f-b604-4f57-81a8-6dca7578db61 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:11.906400 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-5db50fc6-d80d-41f9-9a2c-c0eb92ab91d5 req-56a1c32f-b604-4f57-81a8-6dca7578db61 service nova] Creating event network-changed:f2149286-95eb-4a07-a40a-b3f1eec2ba46 for instance d226a474-361b-42d6-921f-ae69afb7e5f0 on hv-cinder-82160 Dec 13 16:57:11.911989 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-5db50fc6-d80d-41f9-9a2c-c0eb92ab91d5 req-56a1c32f-b604-4f57-81a8-6dca7578db61 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042713 Dec 13 16:57:11.915949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 478/960] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:57:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:57:12.831922 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f628b80c-6016-445f-a429-1b7c76209d15 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:12.832656 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f628b80c-6016-445f-a429-1b7c76209d15 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:12.839909 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f628b80c-6016-445f-a429-1b7c76209d15 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:12.840455 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f628b80c-6016-445f-a429-1b7c76209d15 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:12.841263 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f628b80c-6016-445f-a429-1b7c76209d15 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:12.841696 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f628b80c-6016-445f-a429-1b7c76209d15 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:12.993695 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f628b80c-6016-445f-a429-1b7c76209d15 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:13.001380 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f628b80c-6016-445f-a429-1b7c76209d15 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.173209 Dec 13 16:57:13.002041 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 483/961] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:12 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:14.020081 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-42ea2986-b4d8-4488-8ce1-3493fdb55f7c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:14.020822 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-42ea2986-b4d8-4488-8ce1-3493fdb55f7c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:14.027677 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42ea2986-b4d8-4488-8ce1-3493fdb55f7c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:14.028219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42ea2986-b4d8-4488-8ce1-3493fdb55f7c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:14.029120 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42ea2986-b4d8-4488-8ce1-3493fdb55f7c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:14.029486 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-42ea2986-b4d8-4488-8ce1-3493fdb55f7c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:14.166960 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-42ea2986-b4d8-4488-8ce1-3493fdb55f7c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:14.174975 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-42ea2986-b4d8-4488-8ce1-3493fdb55f7c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.159410 Dec 13 16:57:14.175553 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 479/962] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:14 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:15.196129 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d2eb961b-be0d-4982-a803-f25b1c555128 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:15.196747 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d2eb961b-be0d-4982-a803-f25b1c555128 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:15.203691 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d2eb961b-be0d-4982-a803-f25b1c555128 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:15.204098 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d2eb961b-be0d-4982-a803-f25b1c555128 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:15.204893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d2eb961b-be0d-4982-a803-f25b1c555128 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:15.205317 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d2eb961b-be0d-4982-a803-f25b1c555128 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:15.345685 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-85f036c7-7b24-4e4a-a2ea-df3aa0309c8a req-617850ae-3aad-4953-8938-859392dcc0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d226a474-361b-42d6-921f-ae69afb7e5f0", "name": "network-vif-plugged", "status": "completed", "tag": "f2149286-95eb-4a07-a40a-b3f1eec2ba46"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:15.347205 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:57:15.347205 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:57:15.355460 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-85f036c7-7b24-4e4a-a2ea-df3aa0309c8a req-617850ae-3aad-4953-8938-859392dcc0d8 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:15.356443 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-85f036c7-7b24-4e4a-a2ea-df3aa0309c8a req-617850ae-3aad-4953-8938-859392dcc0d8 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:15.366316 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d2eb961b-be0d-4982-a803-f25b1c555128 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:15.370017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-85f036c7-7b24-4e4a-a2ea-df3aa0309c8a req-617850ae-3aad-4953-8938-859392dcc0d8 service nova] Creating event network-vif-plugged:f2149286-95eb-4a07-a40a-b3f1eec2ba46 for instance d226a474-361b-42d6-921f-ae69afb7e5f0 on hv-cinder-82160 Dec 13 16:57:15.375509 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-85f036c7-7b24-4e4a-a2ea-df3aa0309c8a req-617850ae-3aad-4953-8938-859392dcc0d8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 Dec 13 16:57:15.375829 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d2eb961b-be0d-4982-a803-f25b1c555128 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.183789 Dec 13 16:57:15.376210 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 480/963] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:57:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 16:57:15.376720 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 484/964] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:15 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:16.406282 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-cca195d2-1c87-4223-ac12-e2db744dca3f tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:16.407431 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-cca195d2-1c87-4223-ac12-e2db744dca3f tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:16.418303 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cca195d2-1c87-4223-ac12-e2db744dca3f tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:16.418753 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cca195d2-1c87-4223-ac12-e2db744dca3f tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:16.419603 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cca195d2-1c87-4223-ac12-e2db744dca3f tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:16.420123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-cca195d2-1c87-4223-ac12-e2db744dca3f tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:16.574156 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-cca195d2-1c87-4223-ac12-e2db744dca3f tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:16.581925 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-cca195d2-1c87-4223-ac12-e2db744dca3f tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1357 microversion: 2.1 time: 0.183522 Dec 13 16:57:16.582507 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 481/965] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:16 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:17.603543 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e6d03cae-c437-42aa-8c7c-1c55633ab54e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:17.604390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e6d03cae-c437-42aa-8c7c-1c55633ab54e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:17.615591 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e6d03cae-c437-42aa-8c7c-1c55633ab54e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:17.616372 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e6d03cae-c437-42aa-8c7c-1c55633ab54e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:17.617688 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e6d03cae-c437-42aa-8c7c-1c55633ab54e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:17.618385 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e6d03cae-c437-42aa-8c7c-1c55633ab54e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:17.763553 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e6d03cae-c437-42aa-8c7c-1c55633ab54e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:17.774678 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e6d03cae-c437-42aa-8c7c-1c55633ab54e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1548 microversion: 2.1 time: 0.177840 Dec 13 16:57:17.775431 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 485/966] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:17 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:17.791257 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d44f9074-d423-434d-9f86-163afef1d818 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:17.791835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d44f9074-d423-434d-9f86-163afef1d818 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:17.798598 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d44f9074-d423-434d-9f86-163afef1d818 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:17.799044 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d44f9074-d423-434d-9f86-163afef1d818 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:17.799815 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d44f9074-d423-434d-9f86-163afef1d818 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:17.800249 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d44f9074-d423-434d-9f86-163afef1d818 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:17.947148 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d44f9074-d423-434d-9f86-163afef1d818 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:17.956758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d44f9074-d423-434d-9f86-163afef1d818 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1548 microversion: 2.1 time: 0.169164 Dec 13 16:57:17.957296 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 482/967] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:17 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:17.975166 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:17.980507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:57:17.980507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:57:17.981951 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:17.982778 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Searching by: {'deleted': False, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e'} {{(pid=122886) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 13 16:57:17.989787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:17.990221 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:17.991014 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:17.991424 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:18.078878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.multi_cell_list [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 13 16:57:18.173402 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c326c711-a213-4ee3-92f8-a883b1670699 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204249 Dec 13 16:57:18.173891 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 486/968] 10.222.0.62 () {58 vars in 1124 bytes} [Mon Dec 13 16:57:17 2021] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:57:18.188443 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a731aa86-6983-4d93-bfbb-950981dd75ff tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:18.189065 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a731aa86-6983-4d93-bfbb-950981dd75ff tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:18.195255 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a731aa86-6983-4d93-bfbb-950981dd75ff tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:18.195691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a731aa86-6983-4d93-bfbb-950981dd75ff tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:18.196449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a731aa86-6983-4d93-bfbb-950981dd75ff tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:18.196917 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a731aa86-6983-4d93-bfbb-950981dd75ff tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:18.333018 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a731aa86-6983-4d93-bfbb-950981dd75ff tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:18.340898 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a731aa86-6983-4d93-bfbb-950981dd75ff tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1548 microversion: 2.1 time: 0.156875 Dec 13 16:57:18.341651 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 483/969] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:18 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:19.873435 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-19791efb-5250-4779-a655-f912bc03dcb4 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07852c7f-e205-4617-a4b5-bcd7079d0b47"}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:19.874487 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-19791efb-5250-4779-a655-f912bc03dcb4 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:19.880972 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19791efb-5250-4779-a655-f912bc03dcb4 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:19.881407 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19791efb-5250-4779-a655-f912bc03dcb4 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:19.882171 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19791efb-5250-4779-a655-f912bc03dcb4 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:19.882595 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19791efb-5250-4779-a655-f912bc03dcb4 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:20.139999 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-19791efb-5250-4779-a655-f912bc03dcb4 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "POST /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270353 Dec 13 16:57:20.140660 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 487/970] 10.222.0.62 () {60 vars in 1322 bytes} [Mon Dec 13 16:57:19 2021] POST /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:57:29.825751 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-6b1d516e-757b-4775-af68-242906b377a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:29.826383 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-6b1d516e-757b-4775-af68-242906b377a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:29.836492 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6b1d516e-757b-4775-af68-242906b377a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:29.837173 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6b1d516e-757b-4775-af68-242906b377a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:29.838369 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6b1d516e-757b-4775-af68-242906b377a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:29.838969 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-6b1d516e-757b-4775-af68-242906b377a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:29.986155 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-6b1d516e-757b-4775-af68-242906b377a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:29.998414 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-6b1d516e-757b-4775-af68-242906b377a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1594 microversion: 2.1 time: 0.178424 Dec 13 16:57:29.999230 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 484/971] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:29 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1594 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:32.208000 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-8ba1c7b2-3dd6-487b-b0f2-a8d672a92db8 req-76d2e715-ba3c-4edf-8305-decd1481c444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d226a474-361b-42d6-921f-ae69afb7e5f0", "tag": "f2149286-95eb-4a07-a40a-b3f1eec2ba46"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:32.209089 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:57:32.209089 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:57:32.217613 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-8ba1c7b2-3dd6-487b-b0f2-a8d672a92db8 req-76d2e715-ba3c-4edf-8305-decd1481c444 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:32.218316 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-8ba1c7b2-3dd6-487b-b0f2-a8d672a92db8 req-76d2e715-ba3c-4edf-8305-decd1481c444 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:32.240562 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-8ba1c7b2-3dd6-487b-b0f2-a8d672a92db8 req-76d2e715-ba3c-4edf-8305-decd1481c444 service nova] Creating event network-changed:f2149286-95eb-4a07-a40a-b3f1eec2ba46 for instance d226a474-361b-42d6-921f-ae69afb7e5f0 on hv-cinder-82160 Dec 13 16:57:32.257127 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-8ba1c7b2-3dd6-487b-b0f2-a8d672a92db8 req-76d2e715-ba3c-4edf-8305-decd1481c444 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076124 Dec 13 16:57:32.257940 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 488/972] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:57:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:57:33.290920 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a39f1eb3-7e84-4110-93d5-0217044d9c95 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-531170290"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:33.292057 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a39f1eb3-7e84-4110-93d5-0217044d9c95 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:33.299449 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a39f1eb3-7e84-4110-93d5-0217044d9c95 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:33.299801 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a39f1eb3-7e84-4110-93d5-0217044d9c95 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:33.300548 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a39f1eb3-7e84-4110-93d5-0217044d9c95 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:33.301464 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a39f1eb3-7e84-4110-93d5-0217044d9c95 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:33.435773 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.network.security_group_api [None req-a39f1eb3-7e84-4110-93d5-0217044d9c95 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Adding security group 971a327b-5939-4d35-8ae0-388904809c81 to port f2149286-95eb-4a07-a40a-b3f1eec2ba46 Dec 13 16:57:33.807641 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a39f1eb3-7e84-4110-93d5-0217044d9c95 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "POST /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.520450 Dec 13 16:57:33.809073 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 485/973] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:57:33 2021] POST /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:57:33.817900 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-8b8ee9aa-be1d-4496-8dba-f467dbcf91dc tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:33.818696 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-8b8ee9aa-be1d-4496-8dba-f467dbcf91dc tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:33.824886 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b8ee9aa-be1d-4496-8dba-f467dbcf91dc tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:33.825419 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b8ee9aa-be1d-4496-8dba-f467dbcf91dc tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:33.826453 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b8ee9aa-be1d-4496-8dba-f467dbcf91dc tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:33.826973 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-8b8ee9aa-be1d-4496-8dba-f467dbcf91dc tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:33.997177 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-8b8ee9aa-be1d-4496-8dba-f467dbcf91dc tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:34.006041 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-8b8ee9aa-be1d-4496-8dba-f467dbcf91dc tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1759 microversion: 2.1 time: 0.193045 Dec 13 16:57:34.006622 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 489/974] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:33 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1759 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 16:57:34.272093 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-34198a3b-390a-4585-9d45-f00fcef9c713 req-3cf7f092-28d5-40cf-9827-1b5ae243ecec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d226a474-361b-42d6-921f-ae69afb7e5f0", "tag": "f2149286-95eb-4a07-a40a-b3f1eec2ba46"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:34.273610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:57:34.273610 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:57:34.281123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-34198a3b-390a-4585-9d45-f00fcef9c713 req-3cf7f092-28d5-40cf-9827-1b5ae243ecec service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:34.281561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-34198a3b-390a-4585-9d45-f00fcef9c713 req-3cf7f092-28d5-40cf-9827-1b5ae243ecec service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:34.293024 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-34198a3b-390a-4585-9d45-f00fcef9c713 req-3cf7f092-28d5-40cf-9827-1b5ae243ecec service nova] Creating event network-changed:f2149286-95eb-4a07-a40a-b3f1eec2ba46 for instance d226a474-361b-42d6-921f-ae69afb7e5f0 on hv-cinder-82160 Dec 13 16:57:34.298402 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-34198a3b-390a-4585-9d45-f00fcef9c713 req-3cf7f092-28d5-40cf-9827-1b5ae243ecec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029690 Dec 13 16:57:34.299003 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 486/975] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:57:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:57:45.143228 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d4734850-c621-4389-af35-b9c17426f15f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:45.143794 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d4734850-c621-4389-af35-b9c17426f15f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:45.146158 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-d52c8f79-bb7c-4b3c-a248-5ad5ee7206d4 req-d4abc790-ffd2-4d1d-9b07-e2ddabc6972e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895f7640-e4b3-4cb0-9632-d99cef54dab6", "tag": "7bfe5c97-83ad-4a06-b866-31455cbfdf29"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:45.148395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:57:45.148395 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:57:45.150614 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d4734850-c621-4389-af35-b9c17426f15f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:45.151341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d4734850-c621-4389-af35-b9c17426f15f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:45.152329 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d4734850-c621-4389-af35-b9c17426f15f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:45.152787 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d4734850-c621-4389-af35-b9c17426f15f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:45.156161 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-d52c8f79-bb7c-4b3c-a248-5ad5ee7206d4 req-d4abc790-ffd2-4d1d-9b07-e2ddabc6972e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:45.156627 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-d52c8f79-bb7c-4b3c-a248-5ad5ee7206d4 req-d4abc790-ffd2-4d1d-9b07-e2ddabc6972e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:45.168342 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-d52c8f79-bb7c-4b3c-a248-5ad5ee7206d4 req-d4abc790-ffd2-4d1d-9b07-e2ddabc6972e service nova] Creating event network-changed:7bfe5c97-83ad-4a06-b866-31455cbfdf29 for instance 895f7640-e4b3-4cb0-9632-d99cef54dab6 on hv-cinder-82160 Dec 13 16:57:45.174102 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-d52c8f79-bb7c-4b3c-a248-5ad5ee7206d4 req-d4abc790-ffd2-4d1d-9b07-e2ddabc6972e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032664 Dec 13 16:57:45.175358 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 487/976] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:57:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:57:45.179650 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d4734850-c621-4389-af35-b9c17426f15f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:57:45.264015 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d4734850-c621-4389-af35-b9c17426f15f tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "DELETE /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 204 len: 0 microversion: 2.1 time: 0.124809 Dec 13 16:57:45.264640 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 490/977] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:57:45 2021] DELETE /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:57:45.274505 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a982a23d-118d-43e2-902f-053586479849 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:45.275417 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a982a23d-118d-43e2-902f-053586479849 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:45.281830 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a982a23d-118d-43e2-902f-053586479849 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:45.282281 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a982a23d-118d-43e2-902f-053586479849 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:45.283072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a982a23d-118d-43e2-902f-053586479849 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:45.283504 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a982a23d-118d-43e2-902f-053586479849 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:45.430234 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a982a23d-118d-43e2-902f-053586479849 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:45.438046 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a982a23d-118d-43e2-902f-053586479849 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1566 microversion: 2.1 time: 0.168305 Dec 13 16:57:45.442957 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 488/978] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:45 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:46.460606 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ade16b83-920e-4a2f-ae83-561099534c96 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:46.461351 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ade16b83-920e-4a2f-ae83-561099534c96 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:46.468349 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ade16b83-920e-4a2f-ae83-561099534c96 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:46.468819 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ade16b83-920e-4a2f-ae83-561099534c96 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:46.469585 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ade16b83-920e-4a2f-ae83-561099534c96 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:46.470043 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ade16b83-920e-4a2f-ae83-561099534c96 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:46.781559 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-ade16b83-920e-4a2f-ae83-561099534c96 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:46.793048 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ade16b83-920e-4a2f-ae83-561099534c96 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1447 microversion: 2.1 time: 0.339154 Dec 13 16:57:46.793779 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 491/979] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:46 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1447 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:47.380218 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-b7dd9c23-f510-45af-b1f8-9e027cd41c24 req-3b59c98c-5912-423b-995c-cf59a47a52df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895f7640-e4b3-4cb0-9632-d99cef54dab6", "name": "network-vif-deleted", "tag": "7bfe5c97-83ad-4a06-b866-31455cbfdf29"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:47.381815 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:57:47.381815 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:57:47.390131 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b7dd9c23-f510-45af-b1f8-9e027cd41c24 req-3b59c98c-5912-423b-995c-cf59a47a52df service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:47.390595 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b7dd9c23-f510-45af-b1f8-9e027cd41c24 req-3b59c98c-5912-423b-995c-cf59a47a52df service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:47.402010 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-b7dd9c23-f510-45af-b1f8-9e027cd41c24 req-3b59c98c-5912-423b-995c-cf59a47a52df service nova] Creating event network-vif-deleted:7bfe5c97-83ad-4a06-b866-31455cbfdf29 for instance 895f7640-e4b3-4cb0-9632-d99cef54dab6 on hv-cinder-82160 Dec 13 16:57:47.408099 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-b7dd9c23-f510-45af-b1f8-9e027cd41c24 req-3b59c98c-5912-423b-995c-cf59a47a52df service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031256 Dec 13 16:57:47.408889 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 489/980] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:57:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:57:47.813311 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:47.813911 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:47.820134 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:47.820596 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:47.821486 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:47.821910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:47.854148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:47.854629 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:47.855267 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lazy-loading 'fault' on Instance uuid 895f7640-e4b3-4cb0-9632-d99cef54dab6 {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:57:47.897282 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec44be0e26b44a55910bdccc7c836d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979a51fd9c744bc9a5b0d82595603a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:47.905099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f217fb7c-d4aa-4720-9c5f-ce43e7d6cbe2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 200 len: 1223 microversion: 2.1 time: 0.095610 Dec 13 16:57:47.905655 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 492/981] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:47 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:48.928794 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:48.929703 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] [instance: 895f7640-e4b3-4cb0-9632-d99cef54dab6] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:48.937168 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:48.937603 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:48.938373 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:48.938797 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:48.952457 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] HTTP exception thrown: Instance 895f7640-e4b3-4cb0-9632-d99cef54dab6 could not be found. Dec 13 16:57:48.953073 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Returning 404 to user: Instance 895f7640-e4b3-4cb0-9632-d99cef54dab6 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:57:48.953886 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-32bbf41b-96c3-40b3-bb03-a3d71659d1ef tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6" status: 404 len: 111 microversion: 2.1 time: 0.033159 Dec 13 16:57:48.954408 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 490/982] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:48 2021] GET /compute/v2.1/servers/895f7640-e4b3-4cb0-9632-d99cef54dab6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:57:49.127346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ddb88680-a5e6-434d-a1c2-acdb4170b3e2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] Calling method '.version_select at 0x7f213bf2fa60>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:49.148641 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ddb88680-a5e6-434d-a1c2-acdb4170b3e2 tempest-TestShelveInstance-296017315 tempest-TestShelveInstance-296017315-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-920802042" status: 202 len: 0 microversion: 2.1 time: 0.024869 Dec 13 16:57:49.149341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 493/983] 10.222.0.62 () {58 vars in 1250 bytes} [Mon Dec 13 16:57:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-920802042 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 13 16:57:50.983100 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-eef8f1de-0aa9-4803-9bb5-ef492eff1ea0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:57:50.984094 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-eef8f1de-0aa9-4803-9bb5-ef492eff1ea0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:50.990725 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eef8f1de-0aa9-4803-9bb5-ef492eff1ea0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:50.991160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eef8f1de-0aa9-4803-9bb5-ef492eff1ea0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:50.991927 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eef8f1de-0aa9-4803-9bb5-ef492eff1ea0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:50.992349 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eef8f1de-0aa9-4803-9bb5-ef492eff1ea0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:51.071064 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-eef8f1de-0aa9-4803-9bb5-ef492eff1ea0 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "POST /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.091709 Dec 13 16:57:51.072615 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 491/984] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:57:50 2021] POST /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:57:51.088018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-56297948-f8e4-4241-b2f4-800fa545cdcd tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:51.089959 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-56297948-f8e4-4241-b2f4-800fa545cdcd tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:51.100831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56297948-f8e4-4241-b2f4-800fa545cdcd tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:51.102150 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56297948-f8e4-4241-b2f4-800fa545cdcd tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:51.103233 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56297948-f8e4-4241-b2f4-800fa545cdcd tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:51.103893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-56297948-f8e4-4241-b2f4-800fa545cdcd tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:51.354719 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-56297948-f8e4-4241-b2f4-800fa545cdcd tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:51.363582 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-56297948-f8e4-4241-b2f4-800fa545cdcd tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1751 microversion: 2.1 time: 0.282068 Dec 13 16:57:51.364278 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 494/985] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:51 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1751 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:52.383846 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-00ebd856-fbea-4196-ae79-38bba8c9d4b9 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:52.384939 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-00ebd856-fbea-4196-ae79-38bba8c9d4b9 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:52.395771 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-00ebd856-fbea-4196-ae79-38bba8c9d4b9 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:52.396037 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-00ebd856-fbea-4196-ae79-38bba8c9d4b9 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:52.396636 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-00ebd856-fbea-4196-ae79-38bba8c9d4b9 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:52.397067 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-00ebd856-fbea-4196-ae79-38bba8c9d4b9 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:52.644708 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-00ebd856-fbea-4196-ae79-38bba8c9d4b9 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:52.653094 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-00ebd856-fbea-4196-ae79-38bba8c9d4b9 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.274759 Dec 13 16:57:52.653639 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 492/986] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:52 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:53.669657 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c701a95b-bbe7-4990-95e7-eb9fa38f5b0d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:53.670265 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c701a95b-bbe7-4990-95e7-eb9fa38f5b0d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:53.676597 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c701a95b-bbe7-4990-95e7-eb9fa38f5b0d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:53.677045 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c701a95b-bbe7-4990-95e7-eb9fa38f5b0d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:53.677822 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c701a95b-bbe7-4990-95e7-eb9fa38f5b0d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:53.678246 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c701a95b-bbe7-4990-95e7-eb9fa38f5b0d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:53.831603 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c701a95b-bbe7-4990-95e7-eb9fa38f5b0d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:53.839705 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c701a95b-bbe7-4990-95e7-eb9fa38f5b0d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.173730 Dec 13 16:57:53.840279 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 495/987] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:53 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:54.857511 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3ba76085-3d9a-4b74-a33f-db2d1c27fdf6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:54.858110 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3ba76085-3d9a-4b74-a33f-db2d1c27fdf6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:54.865069 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ba76085-3d9a-4b74-a33f-db2d1c27fdf6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:54.865574 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ba76085-3d9a-4b74-a33f-db2d1c27fdf6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:54.866415 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ba76085-3d9a-4b74-a33f-db2d1c27fdf6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:54.866903 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3ba76085-3d9a-4b74-a33f-db2d1c27fdf6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:55.031235 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3ba76085-3d9a-4b74-a33f-db2d1c27fdf6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:55.039562 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3ba76085-3d9a-4b74-a33f-db2d1c27fdf6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.185654 Dec 13 16:57:55.040758 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 493/988] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:54 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:56.057714 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-f464fe46-c0d4-42e9-999e-e120547e079e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:56.058314 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-f464fe46-c0d4-42e9-999e-e120547e079e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:56.065103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f464fe46-c0d4-42e9-999e-e120547e079e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:56.065556 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f464fe46-c0d4-42e9-999e-e120547e079e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:56.066353 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f464fe46-c0d4-42e9-999e-e120547e079e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:56.066793 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-f464fe46-c0d4-42e9-999e-e120547e079e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:56.215371 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-f464fe46-c0d4-42e9-999e-e120547e079e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:56.223198 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-f464fe46-c0d4-42e9-999e-e120547e079e tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.169456 Dec 13 16:57:56.223769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 496/989] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:56 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:57.244883 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2e0f7164-7150-46b9-9b75-5e859b567113 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:57.245508 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2e0f7164-7150-46b9-9b75-5e859b567113 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:57.252297 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e0f7164-7150-46b9-9b75-5e859b567113 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:57.252780 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e0f7164-7150-46b9-9b75-5e859b567113 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:57.253560 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e0f7164-7150-46b9-9b75-5e859b567113 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:57.253965 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e0f7164-7150-46b9-9b75-5e859b567113 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:57.408502 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2e0f7164-7150-46b9-9b75-5e859b567113 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:57.417084 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2e0f7164-7150-46b9-9b75-5e859b567113 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.176987 Dec 13 16:57:57.417767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 494/990] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:57 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:58.436836 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b6b38784-cdbd-48d2-814e-3bfed0479ee2 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:58.437776 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b6b38784-cdbd-48d2-814e-3bfed0479ee2 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:58.448299 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b6b38784-cdbd-48d2-814e-3bfed0479ee2 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:58.449038 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b6b38784-cdbd-48d2-814e-3bfed0479ee2 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:58.450228 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b6b38784-cdbd-48d2-814e-3bfed0479ee2 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:58.450913 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b6b38784-cdbd-48d2-814e-3bfed0479ee2 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:58.614120 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b6b38784-cdbd-48d2-814e-3bfed0479ee2 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:58.623561 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b6b38784-cdbd-48d2-814e-3bfed0479ee2 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.192700 Dec 13 16:57:58.624123 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 497/991] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:58 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:57:59.644994 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a21ff4c6-f2ac-411a-b9af-7f0ca8dff862 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:57:59.645922 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a21ff4c6-f2ac-411a-b9af-7f0ca8dff862 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:57:59.656677 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a21ff4c6-f2ac-411a-b9af-7f0ca8dff862 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:59.657548 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a21ff4c6-f2ac-411a-b9af-7f0ca8dff862 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:59.658669 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a21ff4c6-f2ac-411a-b9af-7f0ca8dff862 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:57:59.659375 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a21ff4c6-f2ac-411a-b9af-7f0ca8dff862 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:57:59.817304 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a21ff4c6-f2ac-411a-b9af-7f0ca8dff862 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:57:59.827116 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a21ff4c6-f2ac-411a-b9af-7f0ca8dff862 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.188403 Dec 13 16:57:59.827677 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 495/992] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:57:59 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:58:00.844660 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-af3be5bd-24aa-4d26-b315-ac93e4e78c88 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:00.845398 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-af3be5bd-24aa-4d26-b315-ac93e4e78c88 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:00.852735 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-af3be5bd-24aa-4d26-b315-ac93e4e78c88 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:00.853192 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-af3be5bd-24aa-4d26-b315-ac93e4e78c88 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:00.854066 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-af3be5bd-24aa-4d26-b315-ac93e4e78c88 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:00.854538 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-af3be5bd-24aa-4d26-b315-ac93e4e78c88 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:01.014375 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-af3be5bd-24aa-4d26-b315-ac93e4e78c88 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:58:01.022273 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-af3be5bd-24aa-4d26-b315-ac93e4e78c88 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.181499 Dec 13 16:58:01.022828 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 498/993] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:58:00 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:58:02.043729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2028a845-ff44-46e9-a4d7-cd2c1bc095cf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:02.044772 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2028a845-ff44-46e9-a4d7-cd2c1bc095cf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:02.055414 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2028a845-ff44-46e9-a4d7-cd2c1bc095cf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:02.056159 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2028a845-ff44-46e9-a4d7-cd2c1bc095cf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:02.057481 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2028a845-ff44-46e9-a4d7-cd2c1bc095cf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:02.058194 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2028a845-ff44-46e9-a4d7-cd2c1bc095cf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:02.226073 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2028a845-ff44-46e9-a4d7-cd2c1bc095cf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:58:02.237871 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2028a845-ff44-46e9-a4d7-cd2c1bc095cf tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1756 microversion: 2.1 time: 0.200377 Dec 13 16:58:02.238642 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 496/994] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:58:02 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:58:03.260901 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d66d403a-de92-446b-837d-4ce1cf256d6d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:03.261856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d66d403a-de92-446b-837d-4ce1cf256d6d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:03.272867 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d66d403a-de92-446b-837d-4ce1cf256d6d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:03.273609 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d66d403a-de92-446b-837d-4ce1cf256d6d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:03.274610 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d66d403a-de92-446b-837d-4ce1cf256d6d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:03.275033 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d66d403a-de92-446b-837d-4ce1cf256d6d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:03.440520 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d66d403a-de92-446b-837d-4ce1cf256d6d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:58:03.449267 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d66d403a-de92-446b-837d-4ce1cf256d6d tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1759 microversion: 2.1 time: 0.194768 Dec 13 16:58:03.449874 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 499/995] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:58:03 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1759 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:58:35.918412 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8835796f-37ec-4f5d-8098-8570398da4c7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-531170290"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:58:35.919199 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8835796f-37ec-4f5d-8098-8570398da4c7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:35.927386 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8835796f-37ec-4f5d-8098-8570398da4c7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:35.927939 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8835796f-37ec-4f5d-8098-8570398da4c7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:35.929054 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8835796f-37ec-4f5d-8098-8570398da4c7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:35.929588 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8835796f-37ec-4f5d-8098-8570398da4c7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:36.298440 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.network.security_group_api [None req-8835796f-37ec-4f5d-8098-8570398da4c7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Removing security group 971a327b-5939-4d35-8ae0-388904809c81 from port f2149286-95eb-4a07-a40a-b3f1eec2ba46 Dec 13 16:58:36.912229 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8835796f-37ec-4f5d-8098-8570398da4c7 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "POST /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/action" status: 202 len: 0 microversion: 2.1 time: 0.998589 Dec 13 16:58:36.913350 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 497/996] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Dec 13 16:58:35 2021] POST /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/action => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:58:36.928609 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-d143f680-7885-4591-aeec-49a42db17ad5 req-f0e3b0ae-af32-418a-b144-53f430874ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d226a474-361b-42d6-921f-ae69afb7e5f0", "tag": "f2149286-95eb-4a07-a40a-b3f1eec2ba46"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:58:36.930107 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:58:36.930107 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:58:36.940291 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-d143f680-7885-4591-aeec-49a42db17ad5 req-f0e3b0ae-af32-418a-b144-53f430874ac6 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:36.940762 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-d143f680-7885-4591-aeec-49a42db17ad5 req-f0e3b0ae-af32-418a-b144-53f430874ac6 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:36.966791 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-d143f680-7885-4591-aeec-49a42db17ad5 req-f0e3b0ae-af32-418a-b144-53f430874ac6 service nova] Creating event network-changed:f2149286-95eb-4a07-a40a-b3f1eec2ba46 for instance d226a474-361b-42d6-921f-ae69afb7e5f0 on hv-cinder-82160 Dec 13 16:58:36.976822 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-d143f680-7885-4591-aeec-49a42db17ad5 req-f0e3b0ae-af32-418a-b144-53f430874ac6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051713 Dec 13 16:58:36.980803 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 500/997] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:58:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:58:38.081246 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a56725c1-c7ba-4230-86cc-523767116d3c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:38.081799 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a56725c1-c7ba-4230-86cc-523767116d3c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:38.087847 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a56725c1-c7ba-4230-86cc-523767116d3c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:38.088284 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a56725c1-c7ba-4230-86cc-523767116d3c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:38.089724 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a56725c1-c7ba-4230-86cc-523767116d3c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:38.090160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a56725c1-c7ba-4230-86cc-523767116d3c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:38.171745 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.objects.instance [None req-a56725c1-c7ba-4230-86cc-523767116d3c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lazy-loading 'services' on Instance uuid d226a474-361b-42d6-921f-ae69afb7e5f0 {{(pid=122885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:58:38.254137 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a56725c1-c7ba-4230-86cc-523767116d3c tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments/07852c7f-e205-4617-a4b5-bcd7079d0b47" status: 202 len: 0 microversion: 2.1 time: 0.177391 Dec 13 16:58:38.255730 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 498/998] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:58:38 2021] DELETE /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments/07852c7f-e205-4617-a4b5-bcd7079d0b47 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:58:38.265114 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9d8e36e9-f898-4322-8ea9-8f2d0fcf5907 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:38.266271 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9d8e36e9-f898-4322-8ea9-8f2d0fcf5907 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:38.273650 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9d8e36e9-f898-4322-8ea9-8f2d0fcf5907 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:38.274206 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9d8e36e9-f898-4322-8ea9-8f2d0fcf5907 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:38.275223 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9d8e36e9-f898-4322-8ea9-8f2d0fcf5907 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:38.275870 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9d8e36e9-f898-4322-8ea9-8f2d0fcf5907 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:38.309537 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9d8e36e9-f898-4322-8ea9-8f2d0fcf5907 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049058 Dec 13 16:58:38.310112 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 501/999] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:58:38 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:58:38.997820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-98138c97-9c3f-49cd-b8d4-8f9575971445 req-6665444d-1721-4a00-b815-3e60ac44bc5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d226a474-361b-42d6-921f-ae69afb7e5f0", "tag": "f2149286-95eb-4a07-a40a-b3f1eec2ba46"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:58:38.999820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:58:38.999820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:58:39.006992 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-98138c97-9c3f-49cd-b8d4-8f9575971445 req-6665444d-1721-4a00-b815-3e60ac44bc5a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:39.007426 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-98138c97-9c3f-49cd-b8d4-8f9575971445 req-6665444d-1721-4a00-b815-3e60ac44bc5a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:39.017944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-98138c97-9c3f-49cd-b8d4-8f9575971445 req-6665444d-1721-4a00-b815-3e60ac44bc5a service nova] Creating event network-changed:f2149286-95eb-4a07-a40a-b3f1eec2ba46 for instance d226a474-361b-42d6-921f-ae69afb7e5f0 on hv-cinder-82160 Dec 13 16:58:39.022963 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-98138c97-9c3f-49cd-b8d4-8f9575971445 req-6665444d-1721-4a00-b815-3e60ac44bc5a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030438 Dec 13 16:58:39.023548 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 499/1000] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:58:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:58:39.322254 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-ff67d019-7040-4b67-9619-58b794cccb23 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:39.323543 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-ff67d019-7040-4b67-9619-58b794cccb23 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:39.330790 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff67d019-7040-4b67-9619-58b794cccb23 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:39.331318 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff67d019-7040-4b67-9619-58b794cccb23 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:39.332363 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff67d019-7040-4b67-9619-58b794cccb23 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:39.332854 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-ff67d019-7040-4b67-9619-58b794cccb23 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:39.363610 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-ff67d019-7040-4b67-9619-58b794cccb23 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045190 Dec 13 16:58:39.364193 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 502/1001] 10.222.0.62 () {58 vars in 1301 bytes} [Mon Dec 13 16:58:39 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 13 16:58:39.374651 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:39.375215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:39.382044 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:39.382495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:39.383272 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:39.383701 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:39.458999 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] HTTP exception thrown: Instance d226a474-361b-42d6-921f-ae69afb7e5f0 is not attached to volume 07852c7f-e205-4617-a4b5-bcd7079d0b47 Dec 13 16:58:39.459597 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Returning 404 to user: Instance d226a474-361b-42d6-921f-ae69afb7e5f0 is not attached to volume 07852c7f-e205-4617-a4b5-bcd7079d0b47 {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:58:39.460432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-220b53db-7e04-4f0d-a63a-c75ae61135c8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments/07852c7f-e205-4617-a4b5-bcd7079d0b47" status: 404 len: 154 microversion: 2.1 time: 0.090168 Dec 13 16:58:39.461013 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 500/1002] 10.222.0.62 () {58 vars in 1415 bytes} [Mon Dec 13 16:58:39 2021] DELETE /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0/os-volume_attachments/07852c7f-e205-4617-a4b5-bcd7079d0b47 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:58:40.599942 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-175ef9b2-0ed4-476c-86a1-1b1a1d3315a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:40.600442 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-175ef9b2-0ed4-476c-86a1-1b1a1d3315a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:40.607367 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-175ef9b2-0ed4-476c-86a1-1b1a1d3315a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:40.607849 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-175ef9b2-0ed4-476c-86a1-1b1a1d3315a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:40.608669 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-175ef9b2-0ed4-476c-86a1-1b1a1d3315a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:40.609117 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-175ef9b2-0ed4-476c-86a1-1b1a1d3315a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:40.634403 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-175ef9b2-0ed4-476c-86a1-1b1a1d3315a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 16:58:40.725768 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-175ef9b2-0ed4-476c-86a1-1b1a1d3315a8 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 204 len: 0 microversion: 2.1 time: 0.129575 Dec 13 16:58:40.726926 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 503/1003] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 16:58:40 2021] DELETE /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 16:58:40.735830 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-49d86fe9-55ec-4956-8289-a5a52f69a3a6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:40.736625 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-49d86fe9-55ec-4956-8289-a5a52f69a3a6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:40.743657 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-49d86fe9-55ec-4956-8289-a5a52f69a3a6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:40.744111 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-49d86fe9-55ec-4956-8289-a5a52f69a3a6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:40.744950 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-49d86fe9-55ec-4956-8289-a5a52f69a3a6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:40.745380 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-49d86fe9-55ec-4956-8289-a5a52f69a3a6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:40.906820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-49d86fe9-55ec-4956-8289-a5a52f69a3a6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:58:40.915713 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-49d86fe9-55ec-4956-8289-a5a52f69a3a6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1554 microversion: 2.1 time: 0.184054 Dec 13 16:58:40.917028 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 501/1004] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:58:40 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:58:41.938017 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-647d9480-fe49-45d3-8e1a-3d5cd2be7d56 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:41.938774 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-647d9480-fe49-45d3-8e1a-3d5cd2be7d56 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:41.945766 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-647d9480-fe49-45d3-8e1a-3d5cd2be7d56 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:41.946212 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-647d9480-fe49-45d3-8e1a-3d5cd2be7d56 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:41.946985 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-647d9480-fe49-45d3-8e1a-3d5cd2be7d56 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:41.947415 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-647d9480-fe49-45d3-8e1a-3d5cd2be7d56 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:42.119327 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 16:58:42.119771 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 16:58:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 16:58:42.169429 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-647d9480-fe49-45d3-8e1a-3d5cd2be7d56 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:58:42.177851 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-647d9480-fe49-45d3-8e1a-3d5cd2be7d56 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1554 microversion: 2.1 time: 0.246500 Dec 13 16:58:42.178423 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 504/1005] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:58:41 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:58:42.931704 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-c4c04fbd-1a01-4e5d-a732-f806a6c5e762 req-45050be3-210e-4474-a370-54c925d44138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d226a474-361b-42d6-921f-ae69afb7e5f0", "name": "network-vif-deleted", "tag": "f2149286-95eb-4a07-a40a-b3f1eec2ba46"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:58:42.933651 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:58:42.933651 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:58:42.941642 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-c4c04fbd-1a01-4e5d-a732-f806a6c5e762 req-45050be3-210e-4474-a370-54c925d44138 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:42.942315 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-c4c04fbd-1a01-4e5d-a732-f806a6c5e762 req-45050be3-210e-4474-a370-54c925d44138 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:42.954163 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-c4c04fbd-1a01-4e5d-a732-f806a6c5e762 req-45050be3-210e-4474-a370-54c925d44138 service nova] Creating event network-vif-deleted:f2149286-95eb-4a07-a40a-b3f1eec2ba46 for instance d226a474-361b-42d6-921f-ae69afb7e5f0 on hv-cinder-82160 Dec 13 16:58:42.959771 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-c4c04fbd-1a01-4e5d-a732-f806a6c5e762 req-45050be3-210e-4474-a370-54c925d44138 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031786 Dec 13 16:58:42.960428 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 502/1006] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:58:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:58:43.199207 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:43.200133 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:43.210358 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:43.211001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:43.212231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:43.212964 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:43.261822 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:43.262269 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:43.262743 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lazy-loading 'fault' on Instance uuid d226a474-361b-42d6-921f-ae69afb7e5f0 {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 16:58:43.305534 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9305e888877a4b799a83a512007958ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a17cfb32dc2b4830a07073b1bb4f821e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:58:43.313948 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c0d5ac80-e5c9-47c8-9d07-80f62e5da054 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 200 len: 1347 microversion: 2.1 time: 0.120437 Dec 13 16:58:43.314600 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 505/1007] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:58:43 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 1347 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:58:44.335008 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:44.335820 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] [instance: d226a474-361b-42d6-921f-ae69afb7e5f0] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:58:44.342571 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:44.343013 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:44.343788 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:58:44.344215 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:58:44.358067 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] HTTP exception thrown: Instance d226a474-361b-42d6-921f-ae69afb7e5f0 could not be found. Dec 13 16:58:44.358645 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Returning 404 to user: Instance d226a474-361b-42d6-921f-ae69afb7e5f0 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 16:58:44.359458 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d00fc0ad-a695-4c72-a0fe-6bc1e1cfefa6 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0" status: 404 len: 111 microversion: 2.1 time: 0.030401 Dec 13 16:58:44.359983 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 503/1008] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:58:44 2021] GET /compute/v2.1/servers/d226a474-361b-42d6-921f-ae69afb7e5f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 16:58:44.368443 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6e43eb63-770c-468a-9ba8-ce97b9944c90 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] Calling method '.version_select at 0x7f213bece9d0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:58:44.389740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6e43eb63-770c-468a-9ba8-ce97b9944c90 tempest-TestMinimumBasicScenario-85730776 tempest-TestMinimumBasicScenario-85730776-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-67187315" status: 202 len: 0 microversion: 2.1 time: 0.025019 Dec 13 16:58:44.390321 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 506/1009] 10.222.0.62 () {58 vars in 1265 bytes} [Mon Dec 13 16:58:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-67187315 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 16:59:02.633607 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-fa2cf8bc-1578-4e08-8119-64d0803da4f0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Action: 'create', calling method: .version_select at 0x7f213bf074c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1391205097"}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:59:02.648444 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-fa2cf8bc-1578-4e08-8119-64d0803da4f0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:59:02.652591 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-fa2cf8bc-1578-4e08-8119-64d0803da4f0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for user 078365e1f861436ba3fc141bf3503ea6 and project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:59:02.960626 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-fa2cf8bc-1578-4e08-8119-64d0803da4f0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:59:02.964901 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-fa2cf8bc-1578-4e08-8119-64d0803da4f0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for user 078365e1f861436ba3fc141bf3503ea6 and project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'key_pairs'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:59:02.979111 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-fa2cf8bc-1578-4e08-8119-64d0803da4f0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.513265 Dec 13 16:59:02.980308 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 504/1010] 10.222.0.62 () {60 vars in 1157 bytes} [Mon Dec 13 16:59:02 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:19.313065 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-199085928", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1391205097", "security_groups": [{"name": "tempest-secgroup-smoke-537173864"}], "block_device_mapping_v2": [{"uuid": "eaccd60d-f236-4a06-8761-b75ce82c2f41", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eba3f539-039b-4d49-b71b-31e5e607e224"}]}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:59:19.435751 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] validate_networks() for [('eba3f539-039b-4d49-b71b-31e5e607e224', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 16:59:19.844675 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 16:59:19.845082 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 16:59:19.845550 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 16:59:19.845951 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 16:59:19.846352 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 16:59:19.855932 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:19.856372 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:19.857225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:19.857649 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:19.874268 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 16:59:19.878380 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for user 078365e1f861436ba3fc141bf3503ea6 and project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 16:59:19.934375 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 16:59:19.936532 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eaccd60d-f236-4a06-8761-b75ce82c2f41',volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 16:59:20.080040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [3b095415-7268-4066-b893-3ff6731c871e] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 13 16:59:21.100651 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [3b095415-7268-4066-b893-3ff6731c871e] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56388. Dec 13 16:59:21.104974 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-a84d7ce0-f62f-4e92-8763-bd2c65d6d347 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.795723 Dec 13 16:59:21.105621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 507/1011] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 16:59:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 16:59:21.118228 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-604b172c-f55b-45d4-93fa-86d2fde65d69 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:21.119077 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-604b172c-f55b-45d4-93fa-86d2fde65d69 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:21.179851 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-604b172c-f55b-45d4-93fa-86d2fde65d69 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:21.187918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-604b172c-f55b-45d4-93fa-86d2fde65d69 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1094 microversion: 2.1 time: 0.074671 Dec 13 16:59:21.188455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 505/1012] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:21 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:22.205637 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-73014729-69bf-4ada-bda7-cc1390050429 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:22.206241 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-73014729-69bf-4ada-bda7-cc1390050429 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:22.213582 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73014729-69bf-4ada-bda7-cc1390050429 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:22.214037 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73014729-69bf-4ada-bda7-cc1390050429 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:22.214836 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73014729-69bf-4ada-bda7-cc1390050429 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:22.215265 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-73014729-69bf-4ada-bda7-cc1390050429 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:22.300234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-73014729-69bf-4ada-bda7-cc1390050429 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:22.308740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-73014729-69bf-4ada-bda7-cc1390050429 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1200 microversion: 2.1 time: 0.107124 Dec 13 16:59:22.309225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 508/1013] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:22 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:23.327973 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a04269bb-fdc2-4cee-8269-932facf6b3e2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:23.329027 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a04269bb-fdc2-4cee-8269-932facf6b3e2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:23.336679 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a04269bb-fdc2-4cee-8269-932facf6b3e2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:23.337114 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a04269bb-fdc2-4cee-8269-932facf6b3e2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:23.337891 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a04269bb-fdc2-4cee-8269-932facf6b3e2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:23.338321 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a04269bb-fdc2-4cee-8269-932facf6b3e2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:23.479226 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a04269bb-fdc2-4cee-8269-932facf6b3e2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:23.487455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a04269bb-fdc2-4cee-8269-932facf6b3e2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.165462 Dec 13 16:59:23.488325 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 506/1014] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:23 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:24.108300 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-1d2d540c-589a-4134-ac82-2a53b2a9dd0b req-ede91a47-4db1-4b55-b895-09cb8a7085db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f01e078-bf24-4ea2-a973-15e33b5e166a", "tag": "ce5bff86-e44a-4419-8a65-26a32a70dba6"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:59:24.110516 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:59:24.110516 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:59:24.118116 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-1d2d540c-589a-4134-ac82-2a53b2a9dd0b req-ede91a47-4db1-4b55-b895-09cb8a7085db service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:24.118692 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-1d2d540c-589a-4134-ac82-2a53b2a9dd0b req-ede91a47-4db1-4b55-b895-09cb8a7085db service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:24.132562 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-1d2d540c-589a-4134-ac82-2a53b2a9dd0b req-ede91a47-4db1-4b55-b895-09cb8a7085db service nova] Creating event network-changed:ce5bff86-e44a-4419-8a65-26a32a70dba6 for instance 5f01e078-bf24-4ea2-a973-15e33b5e166a on hv-cinder-82160 Dec 13 16:59:24.137788 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-1d2d540c-589a-4134-ac82-2a53b2a9dd0b req-ede91a47-4db1-4b55-b895-09cb8a7085db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111560 Dec 13 16:59:24.138386 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 509/1015] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:59:24.505936 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4814f7c2-e844-4ef8-8aff-1bffda8ec6ee tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:24.506555 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4814f7c2-e844-4ef8-8aff-1bffda8ec6ee tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:24.513038 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4814f7c2-e844-4ef8-8aff-1bffda8ec6ee tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:24.513499 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4814f7c2-e844-4ef8-8aff-1bffda8ec6ee tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:24.514348 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4814f7c2-e844-4ef8-8aff-1bffda8ec6ee tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:24.514836 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4814f7c2-e844-4ef8-8aff-1bffda8ec6ee tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:24.650377 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4814f7c2-e844-4ef8-8aff-1bffda8ec6ee tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:24.657948 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4814f7c2-e844-4ef8-8aff-1bffda8ec6ee tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.156245 Dec 13 16:59:24.658514 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 507/1016] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:24 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:25.677396 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-997cc8c6-4fef-4bd8-9568-c8d3e8e6488f tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:25.677994 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-997cc8c6-4fef-4bd8-9568-c8d3e8e6488f tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:25.687452 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-997cc8c6-4fef-4bd8-9568-c8d3e8e6488f tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:25.687894 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-997cc8c6-4fef-4bd8-9568-c8d3e8e6488f tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:25.689378 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-997cc8c6-4fef-4bd8-9568-c8d3e8e6488f tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:25.689810 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-997cc8c6-4fef-4bd8-9568-c8d3e8e6488f tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:25.854083 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-997cc8c6-4fef-4bd8-9568-c8d3e8e6488f tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:25.863024 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-997cc8c6-4fef-4bd8-9568-c8d3e8e6488f tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.191395 Dec 13 16:59:25.863676 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 510/1017] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:25 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:26.882138 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-575f3fea-b18e-46a4-bc17-5711d024dd68 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:26.882760 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-575f3fea-b18e-46a4-bc17-5711d024dd68 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:26.889653 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-575f3fea-b18e-46a4-bc17-5711d024dd68 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:26.890099 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-575f3fea-b18e-46a4-bc17-5711d024dd68 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:26.890877 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-575f3fea-b18e-46a4-bc17-5711d024dd68 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:26.891312 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-575f3fea-b18e-46a4-bc17-5711d024dd68 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:27.053455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-575f3fea-b18e-46a4-bc17-5711d024dd68 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:27.061262 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-575f3fea-b18e-46a4-bc17-5711d024dd68 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.183853 Dec 13 16:59:27.061824 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 508/1018] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:26 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:28.078711 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d35b0695-0a0e-40d6-93dc-066795dd2df9 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:28.079341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d35b0695-0a0e-40d6-93dc-066795dd2df9 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:28.086432 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d35b0695-0a0e-40d6-93dc-066795dd2df9 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:28.086880 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d35b0695-0a0e-40d6-93dc-066795dd2df9 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:28.087674 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d35b0695-0a0e-40d6-93dc-066795dd2df9 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:28.088106 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d35b0695-0a0e-40d6-93dc-066795dd2df9 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:28.244636 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d35b0695-0a0e-40d6-93dc-066795dd2df9 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:28.256587 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d35b0695-0a0e-40d6-93dc-066795dd2df9 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.181495 Dec 13 16:59:28.257163 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 511/1019] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:28 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:29.273606 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8857fea1-7d0f-4ad3-956f-797f8c9cc5a4 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:29.274794 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8857fea1-7d0f-4ad3-956f-797f8c9cc5a4 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:29.281360 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8857fea1-7d0f-4ad3-956f-797f8c9cc5a4 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:29.281796 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8857fea1-7d0f-4ad3-956f-797f8c9cc5a4 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:29.282561 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8857fea1-7d0f-4ad3-956f-797f8c9cc5a4 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:29.282981 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8857fea1-7d0f-4ad3-956f-797f8c9cc5a4 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:29.428036 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8857fea1-7d0f-4ad3-956f-797f8c9cc5a4 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:29.436239 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8857fea1-7d0f-4ad3-956f-797f8c9cc5a4 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.166356 Dec 13 16:59:29.436869 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 509/1020] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:29 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:30.454038 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-b616f327-51a7-4184-b647-d9a5fd833c7a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:30.454697 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-b616f327-51a7-4184-b647-d9a5fd833c7a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:30.461341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b616f327-51a7-4184-b647-d9a5fd833c7a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:30.461788 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b616f327-51a7-4184-b647-d9a5fd833c7a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:30.463148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b616f327-51a7-4184-b647-d9a5fd833c7a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:30.463657 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-b616f327-51a7-4184-b647-d9a5fd833c7a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:30.607261 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-b616f327-51a7-4184-b647-d9a5fd833c7a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:30.615225 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-b616f327-51a7-4184-b647-d9a5fd833c7a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.165134 Dec 13 16:59:30.615815 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 512/1021] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:30 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:31.634394 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-65eb9c10-d2bd-49dd-ad18-378727d28681 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:31.635013 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-65eb9c10-d2bd-49dd-ad18-378727d28681 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:31.642451 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-65eb9c10-d2bd-49dd-ad18-378727d28681 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:31.642913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-65eb9c10-d2bd-49dd-ad18-378727d28681 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:31.643744 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-65eb9c10-d2bd-49dd-ad18-378727d28681 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:31.644187 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-65eb9c10-d2bd-49dd-ad18-378727d28681 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:31.811021 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-65eb9c10-d2bd-49dd-ad18-378727d28681 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:31.821476 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-65eb9c10-d2bd-49dd-ad18-378727d28681 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.191337 Dec 13 16:59:31.822053 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 510/1022] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:31 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:32.844159 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-63ca0566-3cf8-4aa7-823d-425dccd25176 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:32.845099 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-63ca0566-3cf8-4aa7-823d-425dccd25176 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:32.856039 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-63ca0566-3cf8-4aa7-823d-425dccd25176 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:32.856681 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-63ca0566-3cf8-4aa7-823d-425dccd25176 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:32.858089 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-63ca0566-3cf8-4aa7-823d-425dccd25176 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:32.858831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-63ca0566-3cf8-4aa7-823d-425dccd25176 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:33.007490 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-63ca0566-3cf8-4aa7-823d-425dccd25176 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:33.016242 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-63ca0566-3cf8-4aa7-823d-425dccd25176 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.178274 Dec 13 16:59:33.016853 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 513/1023] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:32 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:34.034129 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-a2f8f04d-1c4f-4566-b283-6c0320368133 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:34.034662 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-a2f8f04d-1c4f-4566-b283-6c0320368133 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:34.041373 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2f8f04d-1c4f-4566-b283-6c0320368133 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:34.041903 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2f8f04d-1c4f-4566-b283-6c0320368133 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:34.043041 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2f8f04d-1c4f-4566-b283-6c0320368133 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:34.043164 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-a2f8f04d-1c4f-4566-b283-6c0320368133 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:34.111014 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-a32d28ed-c366-4b77-8e16-0fcbfc60e404 req-f3da78a0-98b5-425c-a921-b00743ad798d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f01e078-bf24-4ea2-a973-15e33b5e166a", "name": "network-vif-plugged", "status": "completed", "tag": "ce5bff86-e44a-4419-8a65-26a32a70dba6"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:59:34.113148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:59:34.113148 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 16:59:34.120687 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-a32d28ed-c366-4b77-8e16-0fcbfc60e404 req-f3da78a0-98b5-425c-a921-b00743ad798d service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:34.121144 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-a32d28ed-c366-4b77-8e16-0fcbfc60e404 req-f3da78a0-98b5-425c-a921-b00743ad798d service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:34.134276 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-a32d28ed-c366-4b77-8e16-0fcbfc60e404 req-f3da78a0-98b5-425c-a921-b00743ad798d service nova] Creating event network-vif-plugged:ce5bff86-e44a-4419-8a65-26a32a70dba6 for instance 5f01e078-bf24-4ea2-a973-15e33b5e166a on hv-cinder-82160 Dec 13 16:59:34.139835 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-a32d28ed-c366-4b77-8e16-0fcbfc60e404 req-f3da78a0-98b5-425c-a921-b00743ad798d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100192 Dec 13 16:59:34.140542 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 514/1024] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:59:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 16:59:34.189941 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-a2f8f04d-1c4f-4566-b283-6c0320368133 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:34.197485 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-a2f8f04d-1c4f-4566-b283-6c0320368133 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.167849 Dec 13 16:59:34.198035 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 511/1025] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:34 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:35.220657 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-36860e86-ea13-4959-ba39-b5436892a881 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:35.221834 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-36860e86-ea13-4959-ba39-b5436892a881 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:35.232110 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-36860e86-ea13-4959-ba39-b5436892a881 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:35.232557 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-36860e86-ea13-4959-ba39-b5436892a881 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:35.233372 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-36860e86-ea13-4959-ba39-b5436892a881 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:35.233801 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-36860e86-ea13-4959-ba39-b5436892a881 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:35.376361 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-36860e86-ea13-4959-ba39-b5436892a881 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:35.383865 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-36860e86-ea13-4959-ba39-b5436892a881 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1265 microversion: 2.1 time: 0.171457 Dec 13 16:59:35.384399 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 515/1026] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:35 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:36.404020 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-34c070b8-454f-4b91-acd6-562aad81c07e tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:36.404986 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-34c070b8-454f-4b91-acd6-562aad81c07e tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:36.414892 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-34c070b8-454f-4b91-acd6-562aad81c07e tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:36.415565 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-34c070b8-454f-4b91-acd6-562aad81c07e tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:36.416781 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-34c070b8-454f-4b91-acd6-562aad81c07e tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:36.417400 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-34c070b8-454f-4b91-acd6-562aad81c07e tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:36.571119 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-34c070b8-454f-4b91-acd6-562aad81c07e tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:36.578857 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-34c070b8-454f-4b91-acd6-562aad81c07e tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1452 microversion: 2.1 time: 0.180477 Dec 13 16:59:36.579348 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 512/1027] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:36 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:36.598167 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d468908b-2d72-4c52-8ee4-0d28de9170fa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 16:59:36.598808 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d468908b-2d72-4c52-8ee4-0d28de9170fa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 16:59:36.608286 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d468908b-2d72-4c52-8ee4-0d28de9170fa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:36.608781 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d468908b-2d72-4c52-8ee4-0d28de9170fa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:36.609571 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d468908b-2d72-4c52-8ee4-0d28de9170fa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:36.610003 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d468908b-2d72-4c52-8ee4-0d28de9170fa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:36.758349 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d468908b-2d72-4c52-8ee4-0d28de9170fa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 16:59:36.766172 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d468908b-2d72-4c52-8ee4-0d28de9170fa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1452 microversion: 2.1 time: 0.174093 Dec 13 16:59:36.766712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 516/1028] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 16:59:36 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 16:59:38.587332 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-58e76da7-7b28-4ced-b554-3fe41bd10abb req-b2478402-6083-45aa-b585-46369ea3dfd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f01e078-bf24-4ea2-a973-15e33b5e166a", "tag": "ce5bff86-e44a-4419-8a65-26a32a70dba6"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 16:59:38.588845 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:59:38.588845 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 16:59:38.595962 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-58e76da7-7b28-4ced-b554-3fe41bd10abb req-b2478402-6083-45aa-b585-46369ea3dfd1 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 16:59:38.596403 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-58e76da7-7b28-4ced-b554-3fe41bd10abb req-b2478402-6083-45aa-b585-46369ea3dfd1 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 16:59:38.607918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-58e76da7-7b28-4ced-b554-3fe41bd10abb req-b2478402-6083-45aa-b585-46369ea3dfd1 service nova] Creating event network-changed:ce5bff86-e44a-4419-8a65-26a32a70dba6 for instance 5f01e078-bf24-4ea2-a973-15e33b5e166a on hv-cinder-82160 Dec 13 16:59:38.614019 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-58e76da7-7b28-4ced-b554-3fe41bd10abb req-b2478402-6083-45aa-b585-46369ea3dfd1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085107 Dec 13 16:59:38.614733 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 513/1029] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 16:59:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:01:33.755011 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed91c2c5-e15f-4715-8214-79deae8acb08] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 13 17:01:33.758505 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-12d7e937-a608-4c03-8db9-2bec46feaccc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:33.758996 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-12d7e937-a608-4c03-8db9-2bec46feaccc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:33.765717 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-12d7e937-a608-4c03-8db9-2bec46feaccc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:33.766231 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-12d7e937-a608-4c03-8db9-2bec46feaccc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:33.767034 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-12d7e937-a608-4c03-8db9-2bec46feaccc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:33.767448 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-12d7e937-a608-4c03-8db9-2bec46feaccc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:33.793593 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-12d7e937-a608-4c03-8db9-2bec46feaccc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 17:01:33.875064 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-12d7e937-a608-4c03-8db9-2bec46feaccc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 204 len: 0 microversion: 2.1 time: 0.122328 Dec 13 17:01:33.875753 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 517/1030] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 17:01:33 2021] DELETE /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 17:01:33.883677 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bebfd775-df39-4a63-b953-688552c2b993] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 13 17:01:33.887812 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-039a5a6d-a33c-404e-a671-494aacb31e61 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:33.888495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-039a5a6d-a33c-404e-a671-494aacb31e61 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:33.895047 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-039a5a6d-a33c-404e-a671-494aacb31e61 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:33.896056 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-039a5a6d-a33c-404e-a671-494aacb31e61 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:33.896882 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-039a5a6d-a33c-404e-a671-494aacb31e61 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:33.897318 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-039a5a6d-a33c-404e-a671-494aacb31e61 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:34.051652 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-039a5a6d-a33c-404e-a671-494aacb31e61 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:34.059873 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-039a5a6d-a33c-404e-a671-494aacb31e61 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1577 microversion: 2.1 time: 0.179283 Dec 13 17:01:34.060423 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 514/1031] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:33 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:35.080841 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-fe83b4de-8e20-4129-a773-4a7e66595af2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:35.081823 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-fe83b4de-8e20-4129-a773-4a7e66595af2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:35.103924 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fe83b4de-8e20-4129-a773-4a7e66595af2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:35.104362 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fe83b4de-8e20-4129-a773-4a7e66595af2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:35.105181 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fe83b4de-8e20-4129-a773-4a7e66595af2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:35.105603 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fe83b4de-8e20-4129-a773-4a7e66595af2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:35.110733 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed91c2c5-e15f-4715-8214-79deae8acb08] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56494. Dec 13 17:01:35.244029 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fe83b4de-8e20-4129-a773-4a7e66595af2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:35.255767 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-fe83b4de-8e20-4129-a773-4a7e66595af2 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1577 microversion: 2.1 time: 0.180415 Dec 13 17:01:35.256340 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 518/1032] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:35 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:36.278098 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-4f9bb7a6-7dbd-4326-be49-29de84737eba tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:36.279279 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-4f9bb7a6-7dbd-4326-be49-29de84737eba tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:36.297306 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f9bb7a6-7dbd-4326-be49-29de84737eba tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:36.297672 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f9bb7a6-7dbd-4326-be49-29de84737eba tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:36.298693 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f9bb7a6-7dbd-4326-be49-29de84737eba tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:36.299125 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-4f9bb7a6-7dbd-4326-be49-29de84737eba tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:36.309265 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] [bebfd775-df39-4a63-b953-688552c2b993] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56498. Dec 13 17:01:36.320584 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-dbce9e04-2950-40a5-b415-b46977335be9 req-1cba83f7-399c-4ee0-bcea-e0d8889d092a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f01e078-bf24-4ea2-a973-15e33b5e166a", "name": "network-vif-deleted", "tag": "ce5bff86-e44a-4419-8a65-26a32a70dba6"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:01:36.322111 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:01:36.322111 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 17:01:36.330661 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-dbce9e04-2950-40a5-b415-b46977335be9 req-1cba83f7-399c-4ee0-bcea-e0d8889d092a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:36.331744 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-dbce9e04-2950-40a5-b415-b46977335be9 req-1cba83f7-399c-4ee0-bcea-e0d8889d092a service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:36.361774 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-dbce9e04-2950-40a5-b415-b46977335be9 req-1cba83f7-399c-4ee0-bcea-e0d8889d092a service nova] Creating event network-vif-deleted:ce5bff86-e44a-4419-8a65-26a32a70dba6 for instance 5f01e078-bf24-4ea2-a973-15e33b5e166a on hv-cinder-82160 Dec 13 17:01:36.371479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-dbce9e04-2950-40a5-b415-b46977335be9 req-1cba83f7-399c-4ee0-bcea-e0d8889d092a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054497 Dec 13 17:01:36.372590 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 519/1033] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:01:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 17:01:36.382950 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-4f9bb7a6-7dbd-4326-be49-29de84737eba tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:36.391001 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-4f9bb7a6-7dbd-4326-be49-29de84737eba tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 200 len: 1510 microversion: 2.1 time: 0.116326 Dec 13 17:01:36.393310 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 515/1034] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:36 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 1510 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:37.409260 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:37.409955 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:37.416875 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:37.417319 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:37.418118 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:37.418574 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:37.433416 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] HTTP exception thrown: Instance 5f01e078-bf24-4ea2-a973-15e33b5e166a could not be found. Dec 13 17:01:37.434023 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Returning 404 to user: Instance 5f01e078-bf24-4ea2-a973-15e33b5e166a could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 17:01:37.434896 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d02210eb-345c-4234-966d-d61f1bda23ab tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 404 len: 111 microversion: 2.1 time: 0.030222 Dec 13 17:01:37.435447 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 520/1035] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:37 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 17:01:37.520072 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1828532524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1391205097", "security_groups": [{"name": "tempest-secgroup-smoke-537173864"}], "block_device_mapping_v2": [{"uuid": "eaccd60d-f236-4a06-8761-b75ce82c2f41", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eba3f539-039b-4d49-b71b-31e5e607e224"}]}} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:01:37.646867 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.network.neutron [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] validate_networks() for [('eba3f539-039b-4d49-b71b-31e5e607e224', None, None, None, None, None)] {{(pid=122885) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 17:01:38.156034 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Flavor limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 17:01:38.156455 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Image limits 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 17:01:38.156972 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Flavor pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 17:01:38.157381 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Image pref 0:0:0 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 17:01:38.157791 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.virt.hardware [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 17:01:38.167619 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:38.168275 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:38.169141 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:38.169578 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:38.186503 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 17:01:38.190376 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.quota [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for user 078365e1f861436ba3fc141bf3503ea6 and project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122885) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 17:01:38.249943 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Going to run 1 instances... {{(pid=122885) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 17:01:38.252080 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eaccd60d-f236-4a06-8761-b75ce82c2f41',volume_size=None,volume_type=None)] {{(pid=122885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 17:01:38.386977 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2e882d25-21ff-4fd5-b6e2-de028f988c6a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.872797 Dec 13 17:01:38.387652 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 516/1036] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 17:01:37 2021] POST /compute/v2.1/servers => generated 405 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 17:01:38.398341 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3df2f862-ca72-4d5c-b2e5-78ba25ab579c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:38.398949 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3df2f862-ca72-4d5c-b2e5-78ba25ab579c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:38.451701 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3df2f862-ca72-4d5c-b2e5-78ba25ab579c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:38.458331 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3df2f862-ca72-4d5c-b2e5-78ba25ab579c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1095 microversion: 2.1 time: 0.064573 Dec 13 17:01:38.459050 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 521/1037] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:38 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:39.476496 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-8e805f5e-443e-4e0a-b2d9-09e1002e8d65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:39.477699 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-8e805f5e-443e-4e0a-b2d9-09e1002e8d65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:39.483852 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8e805f5e-443e-4e0a-b2d9-09e1002e8d65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:39.484301 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8e805f5e-443e-4e0a-b2d9-09e1002e8d65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:39.485143 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8e805f5e-443e-4e0a-b2d9-09e1002e8d65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:39.485579 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-8e805f5e-443e-4e0a-b2d9-09e1002e8d65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:39.978104 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-8e805f5e-443e-4e0a-b2d9-09e1002e8d65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:39.985790 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-8e805f5e-443e-4e0a-b2d9-09e1002e8d65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1211 microversion: 2.1 time: 0.514274 Dec 13 17:01:39.986463 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 517/1038] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:39 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1211 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:40.990222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-71e1995b-3acd-4214-a440-f695a0d402cd req-ef1a7b9d-44be-404c-a912-5975239aeb3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad56e4eb-5642-4629-a5c9-8a11964e1bca", "tag": "360d80e6-017c-4c3b-9987-4843c26e5d73"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:01:40.992605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:01:40.992605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 17:01:41.003202 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ed700f73-e78b-4c77-a92c-b33e7cc7aa76 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:41.004451 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ed700f73-e78b-4c77-a92c-b33e7cc7aa76 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:41.016120 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ed700f73-e78b-4c77-a92c-b33e7cc7aa76 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:41.016856 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ed700f73-e78b-4c77-a92c-b33e7cc7aa76 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:41.017909 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ed700f73-e78b-4c77-a92c-b33e7cc7aa76 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:41.018320 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ed700f73-e78b-4c77-a92c-b33e7cc7aa76 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:41.026735 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-71e1995b-3acd-4214-a440-f695a0d402cd req-ef1a7b9d-44be-404c-a912-5975239aeb3f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:41.029359 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-71e1995b-3acd-4214-a440-f695a0d402cd req-ef1a7b9d-44be-404c-a912-5975239aeb3f service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:41.047234 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-71e1995b-3acd-4214-a440-f695a0d402cd req-ef1a7b9d-44be-404c-a912-5975239aeb3f service nova] Creating event network-changed:360d80e6-017c-4c3b-9987-4843c26e5d73 for instance ad56e4eb-5642-4629-a5c9-8a11964e1bca on hv-cinder-82160 Dec 13 17:01:41.055904 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-71e1995b-3acd-4214-a440-f695a0d402cd req-ef1a7b9d-44be-404c-a912-5975239aeb3f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069683 Dec 13 17:01:41.057100 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 522/1039] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:01:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:01:41.218552 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ed700f73-e78b-4c77-a92c-b33e7cc7aa76 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:41.227621 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ed700f73-e78b-4c77-a92c-b33e7cc7aa76 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.228008 Dec 13 17:01:41.228592 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 518/1040] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:40 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 13 17:01:42.249124 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-14617725-be8c-4ed6-939e-182bb10a1181 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:42.249792 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-14617725-be8c-4ed6-939e-182bb10a1181 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:42.259463 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-14617725-be8c-4ed6-939e-182bb10a1181 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:42.260072 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-14617725-be8c-4ed6-939e-182bb10a1181 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:42.261153 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-14617725-be8c-4ed6-939e-182bb10a1181 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:42.261733 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-14617725-be8c-4ed6-939e-182bb10a1181 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:42.405613 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-14617725-be8c-4ed6-939e-182bb10a1181 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:42.413123 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-14617725-be8c-4ed6-939e-182bb10a1181 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.170282 Dec 13 17:01:42.413691 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 523/1041] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:42 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:43.433972 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-f6f65b74-505f-4771-9e42-75823a964ccf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:43.435021 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-f6f65b74-505f-4771-9e42-75823a964ccf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:43.445318 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f6f65b74-505f-4771-9e42-75823a964ccf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:43.445755 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f6f65b74-505f-4771-9e42-75823a964ccf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:43.446522 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f6f65b74-505f-4771-9e42-75823a964ccf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:43.446949 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-f6f65b74-505f-4771-9e42-75823a964ccf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:43.596151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-f6f65b74-505f-4771-9e42-75823a964ccf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:43.608596 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-f6f65b74-505f-4771-9e42-75823a964ccf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.180956 Dec 13 17:01:43.611028 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 519/1042] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:43 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:44.632887 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-0da0c53b-9e7d-4ada-b0b9-5f014923fddf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:44.633479 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-0da0c53b-9e7d-4ada-b0b9-5f014923fddf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:44.642200 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0da0c53b-9e7d-4ada-b0b9-5f014923fddf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:44.642914 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0da0c53b-9e7d-4ada-b0b9-5f014923fddf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:44.644051 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0da0c53b-9e7d-4ada-b0b9-5f014923fddf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:44.644740 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-0da0c53b-9e7d-4ada-b0b9-5f014923fddf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:44.794848 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-0da0c53b-9e7d-4ada-b0b9-5f014923fddf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:44.802745 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-0da0c53b-9e7d-4ada-b0b9-5f014923fddf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.175779 Dec 13 17:01:44.803294 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 524/1043] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:44 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:45.823767 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-2c9b5a6c-49f5-4ba1-8078-8dd7643f7a06 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:45.824804 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-2c9b5a6c-49f5-4ba1-8078-8dd7643f7a06 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:45.835975 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2c9b5a6c-49f5-4ba1-8078-8dd7643f7a06 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:45.836464 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2c9b5a6c-49f5-4ba1-8078-8dd7643f7a06 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:45.837271 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2c9b5a6c-49f5-4ba1-8078-8dd7643f7a06 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:45.837700 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-2c9b5a6c-49f5-4ba1-8078-8dd7643f7a06 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:45.992867 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-2c9b5a6c-49f5-4ba1-8078-8dd7643f7a06 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:46.000808 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-2c9b5a6c-49f5-4ba1-8078-8dd7643f7a06 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.183454 Dec 13 17:01:46.001375 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 520/1044] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:45 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:47.022745 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3fc4f245-9e7d-42a8-8d2f-f1c2aed1f9cc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:47.023884 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3fc4f245-9e7d-42a8-8d2f-f1c2aed1f9cc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:47.037605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3fc4f245-9e7d-42a8-8d2f-f1c2aed1f9cc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:47.038340 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3fc4f245-9e7d-42a8-8d2f-f1c2aed1f9cc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:47.039624 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3fc4f245-9e7d-42a8-8d2f-f1c2aed1f9cc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:47.040355 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3fc4f245-9e7d-42a8-8d2f-f1c2aed1f9cc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:47.181897 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3fc4f245-9e7d-42a8-8d2f-f1c2aed1f9cc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:47.189706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3fc4f245-9e7d-42a8-8d2f-f1c2aed1f9cc tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.174080 Dec 13 17:01:47.190265 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 525/1045] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:47 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:48.210557 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-18508eb7-ad13-4c7c-b580-d5c17dcacd05 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:48.211518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-18508eb7-ad13-4c7c-b580-d5c17dcacd05 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:48.218944 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18508eb7-ad13-4c7c-b580-d5c17dcacd05 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:48.219386 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18508eb7-ad13-4c7c-b580-d5c17dcacd05 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:48.220151 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18508eb7-ad13-4c7c-b580-d5c17dcacd05 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:48.220597 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-18508eb7-ad13-4c7c-b580-d5c17dcacd05 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:48.370144 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-18508eb7-ad13-4c7c-b580-d5c17dcacd05 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:48.377554 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-18508eb7-ad13-4c7c-b580-d5c17dcacd05 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.173208 Dec 13 17:01:48.378117 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 521/1046] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:48 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:48.383097 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:01:48.383613 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: Mon Dec 13 17:01:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:01:49.398946 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-c422a62b-94e8-40b5-aa3b-96456bfa551c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:49.400002 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-c422a62b-94e8-40b5-aa3b-96456bfa551c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:49.410783 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c422a62b-94e8-40b5-aa3b-96456bfa551c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:49.411519 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c422a62b-94e8-40b5-aa3b-96456bfa551c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:49.412863 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c422a62b-94e8-40b5-aa3b-96456bfa551c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:49.413566 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-c422a62b-94e8-40b5-aa3b-96456bfa551c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:49.568256 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-c422a62b-94e8-40b5-aa3b-96456bfa551c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:49.576908 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-c422a62b-94e8-40b5-aa3b-96456bfa551c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.184377 Dec 13 17:01:49.577404 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 526/1047] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:49 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:50.596626 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-ef1bf6d0-b9e5-43d3-86e8-524582b5c5b0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:50.597432 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-ef1bf6d0-b9e5-43d3-86e8-524582b5c5b0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:50.606518 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ef1bf6d0-b9e5-43d3-86e8-524582b5c5b0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:50.606963 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ef1bf6d0-b9e5-43d3-86e8-524582b5c5b0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:50.607752 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ef1bf6d0-b9e5-43d3-86e8-524582b5c5b0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:50.608179 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-ef1bf6d0-b9e5-43d3-86e8-524582b5c5b0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:50.751828 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-ef1bf6d0-b9e5-43d3-86e8-524582b5c5b0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:50.759225 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-ef1bf6d0-b9e5-43d3-86e8-524582b5c5b0 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.168844 Dec 13 17:01:50.759868 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 522/1048] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:50 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:51.780444 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-746c7467-c212-4d28-9369-5d4123a9d142 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:51.781432 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-746c7467-c212-4d28-9369-5d4123a9d142 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:51.792992 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-746c7467-c212-4d28-9369-5d4123a9d142 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:51.793707 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-746c7467-c212-4d28-9369-5d4123a9d142 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:51.795008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-746c7467-c212-4d28-9369-5d4123a9d142 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:51.795715 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-746c7467-c212-4d28-9369-5d4123a9d142 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:51.948814 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-746c7467-c212-4d28-9369-5d4123a9d142 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:51.956767 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-746c7467-c212-4d28-9369-5d4123a9d142 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.182523 Dec 13 17:01:51.957323 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 527/1049] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:51 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:52.670051 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-b62ff00f-32b3-4633-9c4e-36f05cad098a req-b04c9853-15c1-4299-bacf-48090503c510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad56e4eb-5642-4629-a5c9-8a11964e1bca", "name": "network-vif-plugged", "status": "completed", "tag": "360d80e6-017c-4c3b-9987-4843c26e5d73"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:01:52.671729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:01:52.671729 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 17:01:52.679711 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b62ff00f-32b3-4633-9c4e-36f05cad098a req-b04c9853-15c1-4299-bacf-48090503c510 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:52.680280 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-b62ff00f-32b3-4633-9c4e-36f05cad098a req-b04c9853-15c1-4299-bacf-48090503c510 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:52.693171 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-b62ff00f-32b3-4633-9c4e-36f05cad098a req-b04c9853-15c1-4299-bacf-48090503c510 service nova] Creating event network-vif-plugged:360d80e6-017c-4c3b-9987-4843c26e5d73 for instance ad56e4eb-5642-4629-a5c9-8a11964e1bca on hv-cinder-82160 Dec 13 17:01:52.699222 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-b62ff00f-32b3-4633-9c4e-36f05cad098a req-b04c9853-15c1-4299-bacf-48090503c510 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032849 Dec 13 17:01:52.700006 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 523/1050] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:01:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:01:52.973837 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-9b9d3795-858e-4efd-99d2-8e8701879838 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:52.974459 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-9b9d3795-858e-4efd-99d2-8e8701879838 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:52.981581 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9b9d3795-858e-4efd-99d2-8e8701879838 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:52.982009 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9b9d3795-858e-4efd-99d2-8e8701879838 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:52.982976 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9b9d3795-858e-4efd-99d2-8e8701879838 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:52.983235 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-9b9d3795-858e-4efd-99d2-8e8701879838 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:53.121130 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-9b9d3795-858e-4efd-99d2-8e8701879838 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:53.128605 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-9b9d3795-858e-4efd-99d2-8e8701879838 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1266 microversion: 2.1 time: 0.158509 Dec 13 17:01:53.129182 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 528/1051] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:52 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:54.147018 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e1cfc67b-5833-46df-a794-fde4b110d200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:54.147648 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e1cfc67b-5833-46df-a794-fde4b110d200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:54.154709 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1cfc67b-5833-46df-a794-fde4b110d200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:54.155160 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1cfc67b-5833-46df-a794-fde4b110d200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:54.155925 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1cfc67b-5833-46df-a794-fde4b110d200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:54.156358 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1cfc67b-5833-46df-a794-fde4b110d200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:54.303017 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e1cfc67b-5833-46df-a794-fde4b110d200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:54.311521 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e1cfc67b-5833-46df-a794-fde4b110d200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1454 microversion: 2.1 time: 0.169148 Dec 13 17:01:54.312103 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 524/1052] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:54 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:54.328257 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7d8de36c-7fa5-455b-b1e5-b908b711cafa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:01:54.328887 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7d8de36c-7fa5-455b-b1e5-b908b711cafa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:01:54.335773 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7d8de36c-7fa5-455b-b1e5-b908b711cafa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:54.336222 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7d8de36c-7fa5-455b-b1e5-b908b711cafa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:54.337038 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7d8de36c-7fa5-455b-b1e5-b908b711cafa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:54.337471 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7d8de36c-7fa5-455b-b1e5-b908b711cafa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:54.496541 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7d8de36c-7fa5-455b-b1e5-b908b711cafa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:01:54.504185 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7d8de36c-7fa5-455b-b1e5-b908b711cafa tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1454 microversion: 2.1 time: 0.179628 Dec 13 17:01:54.504798 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 529/1053] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:01:54 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:01:56.241698 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-7238ffb4-7c78-461b-9f24-37c440ee42c6 req-325036d5-9d46-4348-8407-1cd4cb2efa01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad56e4eb-5642-4629-a5c9-8a11964e1bca", "tag": "360d80e6-017c-4c3b-9987-4843c26e5d73"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:01:56.243207 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:01:56.243207 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 17:01:56.251009 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-7238ffb4-7c78-461b-9f24-37c440ee42c6 req-325036d5-9d46-4348-8407-1cd4cb2efa01 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:01:56.251439 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-7238ffb4-7c78-461b-9f24-37c440ee42c6 req-325036d5-9d46-4348-8407-1cd4cb2efa01 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:01:56.262719 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-7238ffb4-7c78-461b-9f24-37c440ee42c6 req-325036d5-9d46-4348-8407-1cd4cb2efa01 service nova] Creating event network-changed:360d80e6-017c-4c3b-9987-4843c26e5d73 for instance ad56e4eb-5642-4629-a5c9-8a11964e1bca on hv-cinder-82160 Dec 13 17:01:56.269786 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-7238ffb4-7c78-461b-9f24-37c440ee42c6 req-325036d5-9d46-4348-8407-1cd4cb2efa01 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031659 Dec 13 17:01:56.270531 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 525/1054] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:01:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:03:41.770200 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2062822550", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1391205097", "security_groups": [{"name": "tempest-secgroup-smoke-537173864"}], "block_device_mapping_v2": [{"uuid": "d0c1cbdb-2236-4c16-82e4-2ae58ae27b10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eba3f539-039b-4d49-b71b-31e5e607e224"}]}} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:03:41.898400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.network.neutron [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] validate_networks() for [('eba3f539-039b-4d49-b71b-31e5e607e224', None, None, None, None, None)] {{(pid=122886) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 13 17:03:42.140005 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:03:42.140564 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 17:03:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:03:42.361942 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Flavor limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 13 17:03:42.362523 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Image limits 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 13 17:03:42.363274 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Flavor pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 13 17:03:42.363941 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Image pref 0:0:0 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 13 17:03:42.364525 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.virt.hardware [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 13 17:03:42.376749 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:42.377188 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:42.378018 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:42.378400 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:42.396704 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 13 17:03:42.400986 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.quota [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Getting quotas for user 078365e1f861436ba3fc141bf3503ea6 and project 8a3d44ae5b7a42349c31171119f79b12. Resources: {'instances', 'ram', 'cores'} {{(pid=122886) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 13 17:03:42.463308 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Going to run 1 instances... {{(pid=122886) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 13 17:03:42.465763 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0c1cbdb-2236-4c16-82e4-2ae58ae27b10',volume_size=None,volume_type=None)] {{(pid=122886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 13 17:03:42.777998 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-759218b1-922b-49d3-9e5a-34d7400d3784 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.012357 Dec 13 17:03:42.779057 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 530/1055] 10.222.0.62 () {60 vars in 1146 bytes} [Mon Dec 13 17:03:41 2021] POST /compute/v2.1/servers => generated 405 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 13 17:03:42.787156 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bebfd775-df39-4a63-b953-688552c2b993] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 13 17:03:42.791613 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-933b3a8a-0d44-4c12-b3f1-c6754c001e98 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:42.792282 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-933b3a8a-0d44-4c12-b3f1-c6754c001e98 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:42.914319 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-933b3a8a-0d44-4c12-b3f1-c6754c001e98 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:42.922096 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-933b3a8a-0d44-4c12-b3f1-c6754c001e98 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1095 microversion: 2.1 time: 0.136711 Dec 13 17:03:42.922667 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 526/1056] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:42 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1095 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:43.939831 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6816ad20-d968-409e-a807-e594bd2d1a65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:43.940460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6816ad20-d968-409e-a807-e594bd2d1a65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:43.947437 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6816ad20-d968-409e-a807-e594bd2d1a65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:43.947878 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6816ad20-d968-409e-a807-e594bd2d1a65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:43.948706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6816ad20-d968-409e-a807-e594bd2d1a65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:43.949168 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6816ad20-d968-409e-a807-e594bd2d1a65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:44.025983 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-6816ad20-d968-409e-a807-e594bd2d1a65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:44.033501 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6816ad20-d968-409e-a807-e594bd2d1a65 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1211 microversion: 2.1 time: 0.097650 Dec 13 17:03:44.043706 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 531/1057] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:43 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:45.054056 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-e1e23af1-180b-409a-947b-16e2b7b9b59b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:45.054897 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-e1e23af1-180b-409a-947b-16e2b7b9b59b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:45.080926 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1e23af1-180b-409a-947b-16e2b7b9b59b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:45.081536 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1e23af1-180b-409a-947b-16e2b7b9b59b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:45.082523 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1e23af1-180b-409a-947b-16e2b7b9b59b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:45.083155 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-e1e23af1-180b-409a-947b-16e2b7b9b59b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:45.108404 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] [bebfd775-df39-4a63-b953-688552c2b993] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 56678. Dec 13 17:03:45.274977 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-e1e23af1-180b-409a-947b-16e2b7b9b59b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:45.285712 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-e1e23af1-180b-409a-947b-16e2b7b9b59b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.235770 Dec 13 17:03:45.286633 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 527/1058] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:45 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:45.322298 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [req-35058fbd-90e9-4b9d-8ea0-f3ccc4839e5a req-8a8f8a88-6184-4483-9318-0db314144e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dfa529-383c-4f90-b557-546ba0af8f62", "tag": "822423e1-32f3-476c-802f-a6193c327e21"}]} {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:03:45.325608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:03:45.325608 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: warnings.warn(msg) Dec 13 17:03:45.338053 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-35058fbd-90e9-4b9d-8ea0-f3ccc4839e5a req-8a8f8a88-6184-4483-9318-0db314144e97 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:45.338712 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [req-35058fbd-90e9-4b9d-8ea0-f3ccc4839e5a req-8a8f8a88-6184-4483-9318-0db314144e97 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:45.372713 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.compute.server_external_events [req-35058fbd-90e9-4b9d-8ea0-f3ccc4839e5a req-8a8f8a88-6184-4483-9318-0db314144e97 service nova] Creating event network-changed:822423e1-32f3-476c-802f-a6193c327e21 for instance a5dfa529-383c-4f90-b557-546ba0af8f62 on hv-cinder-82160 Dec 13 17:03:45.386040 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [req-35058fbd-90e9-4b9d-8ea0-f3ccc4839e5a req-8a8f8a88-6184-4483-9318-0db314144e97 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066281 Dec 13 17:03:45.387897 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 532/1059] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:03:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:03:46.305612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-eb45ed18-1906-4578-af99-2ff8909bd315 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:46.306226 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-eb45ed18-1906-4578-af99-2ff8909bd315 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:46.314388 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eb45ed18-1906-4578-af99-2ff8909bd315 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:46.314832 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eb45ed18-1906-4578-af99-2ff8909bd315 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:46.315630 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eb45ed18-1906-4578-af99-2ff8909bd315 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:46.316113 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-eb45ed18-1906-4578-af99-2ff8909bd315 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:46.461501 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-eb45ed18-1906-4578-af99-2ff8909bd315 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:46.474720 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-eb45ed18-1906-4578-af99-2ff8909bd315 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.173915 Dec 13 17:03:46.476026 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 528/1060] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:46 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:47.494313 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d7ba8ac4-577f-416b-b28c-08bff2a0e523 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:47.494977 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d7ba8ac4-577f-416b-b28c-08bff2a0e523 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:47.502752 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d7ba8ac4-577f-416b-b28c-08bff2a0e523 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:47.503201 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d7ba8ac4-577f-416b-b28c-08bff2a0e523 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:47.504054 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d7ba8ac4-577f-416b-b28c-08bff2a0e523 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:47.504488 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d7ba8ac4-577f-416b-b28c-08bff2a0e523 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:47.661722 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-d7ba8ac4-577f-416b-b28c-08bff2a0e523 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:47.673722 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d7ba8ac4-577f-416b-b28c-08bff2a0e523 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.183574 Dec 13 17:03:47.674284 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 533/1061] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:47 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:48.692246 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3e270f2a-00cb-4a87-aca7-2d5e37e64caf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:48.693132 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3e270f2a-00cb-4a87-aca7-2d5e37e64caf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:48.699919 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3e270f2a-00cb-4a87-aca7-2d5e37e64caf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:48.700360 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3e270f2a-00cb-4a87-aca7-2d5e37e64caf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:48.701396 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3e270f2a-00cb-4a87-aca7-2d5e37e64caf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:48.701880 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3e270f2a-00cb-4a87-aca7-2d5e37e64caf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:48.853100 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3e270f2a-00cb-4a87-aca7-2d5e37e64caf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:48.863135 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3e270f2a-00cb-4a87-aca7-2d5e37e64caf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.174845 Dec 13 17:03:48.863701 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 529/1062] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:48 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:49.883964 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-fd2f184b-8b5f-4f08-aed8-fca25fc361eb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:49.884846 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-fd2f184b-8b5f-4f08-aed8-fca25fc361eb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:49.895019 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fd2f184b-8b5f-4f08-aed8-fca25fc361eb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:49.895478 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fd2f184b-8b5f-4f08-aed8-fca25fc361eb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:49.896532 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fd2f184b-8b5f-4f08-aed8-fca25fc361eb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:49.896997 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-fd2f184b-8b5f-4f08-aed8-fca25fc361eb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:50.041427 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-fd2f184b-8b5f-4f08-aed8-fca25fc361eb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:50.050885 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-fd2f184b-8b5f-4f08-aed8-fca25fc361eb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.173219 Dec 13 17:03:50.051749 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 534/1063] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:49 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:51.071530 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-1d227b8e-7d0b-435f-bb81-2aa2b9d36bad tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:51.072147 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-1d227b8e-7d0b-435f-bb81-2aa2b9d36bad tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:51.079974 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d227b8e-7d0b-435f-bb81-2aa2b9d36bad tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:51.080620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d227b8e-7d0b-435f-bb81-2aa2b9d36bad tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:51.082777 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d227b8e-7d0b-435f-bb81-2aa2b9d36bad tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:51.083252 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-1d227b8e-7d0b-435f-bb81-2aa2b9d36bad tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:51.238326 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-1d227b8e-7d0b-435f-bb81-2aa2b9d36bad tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:51.248375 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-1d227b8e-7d0b-435f-bb81-2aa2b9d36bad tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.180415 Dec 13 17:03:51.249331 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 530/1064] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:51 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:52.272343 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-e17038b2-d687-4852-bc89-a70320eef672 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:52.273013 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-e17038b2-d687-4852-bc89-a70320eef672 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:52.279802 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e17038b2-d687-4852-bc89-a70320eef672 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:52.280226 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e17038b2-d687-4852-bc89-a70320eef672 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:52.281037 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e17038b2-d687-4852-bc89-a70320eef672 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:52.281460 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-e17038b2-d687-4852-bc89-a70320eef672 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:52.433250 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-e17038b2-d687-4852-bc89-a70320eef672 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:52.443368 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-e17038b2-d687-4852-bc89-a70320eef672 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.178511 Dec 13 17:03:52.443950 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 535/1065] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:52 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:53.460932 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-bf3cb7c7-c88b-4a5e-b636-45a42538481a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:53.461641 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-bf3cb7c7-c88b-4a5e-b636-45a42538481a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:53.468445 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf3cb7c7-c88b-4a5e-b636-45a42538481a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:53.468894 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf3cb7c7-c88b-4a5e-b636-45a42538481a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:53.469813 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf3cb7c7-c88b-4a5e-b636-45a42538481a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:53.470181 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-bf3cb7c7-c88b-4a5e-b636-45a42538481a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:53.621987 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-bf3cb7c7-c88b-4a5e-b636-45a42538481a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:53.630711 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-bf3cb7c7-c88b-4a5e-b636-45a42538481a tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.173466 Dec 13 17:03:53.631282 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 531/1066] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:53 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:54.648405 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-dd7afbcb-dedc-46c5-a600-140ddbdf97cb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:54.649043 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-dd7afbcb-dedc-46c5-a600-140ddbdf97cb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:54.655729 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dd7afbcb-dedc-46c5-a600-140ddbdf97cb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:54.656161 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dd7afbcb-dedc-46c5-a600-140ddbdf97cb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:54.657025 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dd7afbcb-dedc-46c5-a600-140ddbdf97cb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:54.657592 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-dd7afbcb-dedc-46c5-a600-140ddbdf97cb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:54.811956 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-dd7afbcb-dedc-46c5-a600-140ddbdf97cb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:54.819963 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-dd7afbcb-dedc-46c5-a600-140ddbdf97cb tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.175730 Dec 13 17:03:54.820545 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 536/1067] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:54 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:55.838061 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-74654920-25eb-4b48-8827-d220c20fba62 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:55.838639 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-74654920-25eb-4b48-8827-d220c20fba62 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:55.845507 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-74654920-25eb-4b48-8827-d220c20fba62 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:55.845942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-74654920-25eb-4b48-8827-d220c20fba62 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:55.846727 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-74654920-25eb-4b48-8827-d220c20fba62 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:55.847152 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-74654920-25eb-4b48-8827-d220c20fba62 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:56.003158 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-74654920-25eb-4b48-8827-d220c20fba62 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:56.012059 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-74654920-25eb-4b48-8827-d220c20fba62 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.178033 Dec 13 17:03:56.012644 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 532/1068] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:55 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:57.029350 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-85e94487-1843-4f4c-bcbc-58c05aeac083 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:57.030286 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-85e94487-1843-4f4c-bcbc-58c05aeac083 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:57.039729 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-85e94487-1843-4f4c-bcbc-58c05aeac083 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:57.040183 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-85e94487-1843-4f4c-bcbc-58c05aeac083 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:57.041047 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-85e94487-1843-4f4c-bcbc-58c05aeac083 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:57.041476 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-85e94487-1843-4f4c-bcbc-58c05aeac083 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:57.196390 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-85e94487-1843-4f4c-bcbc-58c05aeac083 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:57.205075 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-85e94487-1843-4f4c-bcbc-58c05aeac083 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.179554 Dec 13 17:03:57.205648 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 537/1069] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:57 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:57.406835 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-eec2b8d2-969f-4cf0-9a29-0fea07824153 req-8f3a79fb-8c9f-4263-aa31-11c430182ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dfa529-383c-4f90-b557-546ba0af8f62", "name": "network-vif-plugged", "status": "completed", "tag": "822423e1-32f3-476c-802f-a6193c327e21"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:03:57.409351 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:03:57.409351 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 17:03:57.417343 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-eec2b8d2-969f-4cf0-9a29-0fea07824153 req-8f3a79fb-8c9f-4263-aa31-11c430182ee6 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:57.417773 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-eec2b8d2-969f-4cf0-9a29-0fea07824153 req-8f3a79fb-8c9f-4263-aa31-11c430182ee6 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:57.429802 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-eec2b8d2-969f-4cf0-9a29-0fea07824153 req-8f3a79fb-8c9f-4263-aa31-11c430182ee6 service nova] Creating event network-vif-plugged:822423e1-32f3-476c-802f-a6193c327e21 for instance a5dfa529-383c-4f90-b557-546ba0af8f62 on hv-cinder-82160 Dec 13 17:03:57.435146 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-eec2b8d2-969f-4cf0-9a29-0fea07824153 req-8f3a79fb-8c9f-4263-aa31-11c430182ee6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031940 Dec 13 17:03:57.435711 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 533/1070] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:03:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:03:58.222769 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7d4367da-d67b-4626-bbee-b230440a7200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:58.223365 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-7d4367da-d67b-4626-bbee-b230440a7200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:58.230389 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7d4367da-d67b-4626-bbee-b230440a7200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:58.230839 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7d4367da-d67b-4626-bbee-b230440a7200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:58.231621 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7d4367da-d67b-4626-bbee-b230440a7200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:58.232054 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-7d4367da-d67b-4626-bbee-b230440a7200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:58.371786 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-7d4367da-d67b-4626-bbee-b230440a7200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:58.379384 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7d4367da-d67b-4626-bbee-b230440a7200 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1266 microversion: 2.1 time: 0.160568 Dec 13 17:03:58.379944 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 538/1071] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:58 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:59.396522 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-3eedaf00-6eb0-4e91-bf98-c2eece5fe8c3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:59.397233 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-3eedaf00-6eb0-4e91-bf98-c2eece5fe8c3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:59.403961 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3eedaf00-6eb0-4e91-bf98-c2eece5fe8c3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:59.404379 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3eedaf00-6eb0-4e91-bf98-c2eece5fe8c3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:59.405194 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3eedaf00-6eb0-4e91-bf98-c2eece5fe8c3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:59.405620 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-3eedaf00-6eb0-4e91-bf98-c2eece5fe8c3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:59.555441 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-3eedaf00-6eb0-4e91-bf98-c2eece5fe8c3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:59.563609 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-3eedaf00-6eb0-4e91-bf98-c2eece5fe8c3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1453 microversion: 2.1 time: 0.171700 Dec 13 17:03:59.564271 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 534/1072] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:59 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:03:59.581771 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-92ecf4ca-e2d0-4dbf-9a3e-85bae29b562b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:03:59.582333 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-92ecf4ca-e2d0-4dbf-9a3e-85bae29b562b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:03:59.591807 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92ecf4ca-e2d0-4dbf-9a3e-85bae29b562b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:59.592528 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92ecf4ca-e2d0-4dbf-9a3e-85bae29b562b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:59.593856 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92ecf4ca-e2d0-4dbf-9a3e-85bae29b562b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:03:59.594673 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-92ecf4ca-e2d0-4dbf-9a3e-85bae29b562b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:03:59.749420 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-92ecf4ca-e2d0-4dbf-9a3e-85bae29b562b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:03:59.758001 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-92ecf4ca-e2d0-4dbf-9a3e-85bae29b562b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1453 microversion: 2.1 time: 0.181225 Dec 13 17:03:59.758664 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 539/1073] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:03:59 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:04:01.775075 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-0601cc12-2195-4199-bad5-201f44d0592a req-9339dc1c-9f1c-4404-94c6-96c0532f256e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dfa529-383c-4f90-b557-546ba0af8f62", "tag": "822423e1-32f3-476c-802f-a6193c327e21"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:04:01.776607 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:04:01.776607 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 17:04:01.784255 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-0601cc12-2195-4199-bad5-201f44d0592a req-9339dc1c-9f1c-4404-94c6-96c0532f256e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:04:01.784816 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-0601cc12-2195-4199-bad5-201f44d0592a req-9339dc1c-9f1c-4404-94c6-96c0532f256e service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:04:01.796070 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-0601cc12-2195-4199-bad5-201f44d0592a req-9339dc1c-9f1c-4404-94c6-96c0532f256e service nova] Creating event network-changed:822423e1-32f3-476c-802f-a6193c327e21 for instance a5dfa529-383c-4f90-b557-546ba0af8f62 on hv-cinder-82160 Dec 13 17:04:01.801671 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-0601cc12-2195-4199-bad5-201f44d0592a req-9339dc1c-9f1c-4404-94c6-96c0532f256e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030180 Dec 13 17:04:01.802481 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 535/1074] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:04:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 13 17:04:12.803422 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:04:12.804421 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 17:04:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:05:08.401673 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:05:08.402766 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: Mon Dec 13 17:05:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:05:30.298821 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-6ec78b75-7659-4b36-b39a-e2cb2f642531 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:30.299544 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6ec78b75-7659-4b36-b39a-e2cb2f642531 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:30.306492 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6ec78b75-7659-4b36-b39a-e2cb2f642531 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:30.307165 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6ec78b75-7659-4b36-b39a-e2cb2f642531 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:30.307963 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6ec78b75-7659-4b36-b39a-e2cb2f642531 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:30.308396 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-6ec78b75-7659-4b36-b39a-e2cb2f642531 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:30.336041 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-6ec78b75-7659-4b36-b39a-e2cb2f642531 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 17:05:30.363584 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-6e856b0a-5e69-4745-b9fe-2edf5d8b9684 req-adb1dc6d-63af-4fad-bd2e-f40cd9aa6b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5dfa529-383c-4f90-b557-546ba0af8f62", "tag": "822423e1-32f3-476c-802f-a6193c327e21"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:05:30.365175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:05:30.365175 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 17:05:30.372354 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-6e856b0a-5e69-4745-b9fe-2edf5d8b9684 req-adb1dc6d-63af-4fad-bd2e-f40cd9aa6b4b service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:30.372807 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-6e856b0a-5e69-4745-b9fe-2edf5d8b9684 req-adb1dc6d-63af-4fad-bd2e-f40cd9aa6b4b service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:30.384219 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-6e856b0a-5e69-4745-b9fe-2edf5d8b9684 req-adb1dc6d-63af-4fad-bd2e-f40cd9aa6b4b service nova] Creating event network-changed:822423e1-32f3-476c-802f-a6193c327e21 for instance a5dfa529-383c-4f90-b557-546ba0af8f62 on hv-cinder-82160 Dec 13 17:05:30.389837 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-6e856b0a-5e69-4745-b9fe-2edf5d8b9684 req-adb1dc6d-63af-4fad-bd2e-f40cd9aa6b4b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101625 Dec 13 17:05:30.390350 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 536/1075] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:05:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:05:30.427966 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-6ec78b75-7659-4b36-b39a-e2cb2f642531 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 204 len: 0 microversion: 2.1 time: 0.141519 Dec 13 17:05:30.432098 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 540/1076] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 17:05:30 2021] DELETE /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 17:05:30.438239 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d018a506-62c2-4b20-8a40-2500b7610979 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:30.439198 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d018a506-62c2-4b20-8a40-2500b7610979 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:30.445797 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d018a506-62c2-4b20-8a40-2500b7610979 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:30.446459 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d018a506-62c2-4b20-8a40-2500b7610979 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:30.447417 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d018a506-62c2-4b20-8a40-2500b7610979 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:30.448022 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d018a506-62c2-4b20-8a40-2500b7610979 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:30.587742 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d018a506-62c2-4b20-8a40-2500b7610979 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:05:30.596117 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d018a506-62c2-4b20-8a40-2500b7610979 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1577 microversion: 2.1 time: 0.162268 Dec 13 17:05:30.597080 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 537/1077] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:30 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:05:31.615920 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-2a49554a-fe0c-4d90-9237-d6175b77d602 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:31.616771 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-2a49554a-fe0c-4d90-9237-d6175b77d602 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:31.623500 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2a49554a-fe0c-4d90-9237-d6175b77d602 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:31.624053 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2a49554a-fe0c-4d90-9237-d6175b77d602 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:31.624762 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2a49554a-fe0c-4d90-9237-d6175b77d602 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:31.625194 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-2a49554a-fe0c-4d90-9237-d6175b77d602 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:31.778474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-2a49554a-fe0c-4d90-9237-d6175b77d602 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:05:31.786415 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-2a49554a-fe0c-4d90-9237-d6175b77d602 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1459 microversion: 2.1 time: 0.174625 Dec 13 17:05:31.787044 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 541/1078] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:31 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1459 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:05:32.557466 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-4f046a40-c134-4223-afa6-f6c039bf1eb3 req-75e64f0f-1717-4e63-86f6-ecc56d4c8409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5dfa529-383c-4f90-b557-546ba0af8f62", "name": "network-vif-deleted", "tag": "822423e1-32f3-476c-802f-a6193c327e21"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:05:32.559123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:05:32.559123 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 17:05:32.565929 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-4f046a40-c134-4223-afa6-f6c039bf1eb3 req-75e64f0f-1717-4e63-86f6-ecc56d4c8409 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:32.566370 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-4f046a40-c134-4223-afa6-f6c039bf1eb3 req-75e64f0f-1717-4e63-86f6-ecc56d4c8409 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:32.577071 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-4f046a40-c134-4223-afa6-f6c039bf1eb3 req-75e64f0f-1717-4e63-86f6-ecc56d4c8409 service nova] Creating event network-vif-deleted:822423e1-32f3-476c-802f-a6193c327e21 for instance a5dfa529-383c-4f90-b557-546ba0af8f62 on hv-cinder-82160 Dec 13 17:05:32.581612 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-4f046a40-c134-4223-afa6-f6c039bf1eb3 req-75e64f0f-1717-4e63-86f6-ecc56d4c8409 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078514 Dec 13 17:05:32.582261 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 538/1079] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:05:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:05:32.803584 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-19464c32-94da-4de9-80c6-9d44e0bb1da3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:32.804346 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-19464c32-94da-4de9-80c6-9d44e0bb1da3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:32.812254 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19464c32-94da-4de9-80c6-9d44e0bb1da3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:32.812913 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19464c32-94da-4de9-80c6-9d44e0bb1da3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:32.813786 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19464c32-94da-4de9-80c6-9d44e0bb1da3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:32.814357 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-19464c32-94da-4de9-80c6-9d44e0bb1da3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:32.886039 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-19464c32-94da-4de9-80c6-9d44e0bb1da3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:05:32.894620 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-19464c32-94da-4de9-80c6-9d44e0bb1da3 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 200 len: 1226 microversion: 2.1 time: 0.094928 Dec 13 17:05:32.895205 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 542/1080] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:32 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:05:33.916843 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:33.917912 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: a5dfa529-383c-4f90-b557-546ba0af8f62] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:33.928435 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:33.929217 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:33.930473 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:33.931189 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:33.946376 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] HTTP exception thrown: Instance a5dfa529-383c-4f90-b557-546ba0af8f62 could not be found. Dec 13 17:05:33.946979 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Returning 404 to user: Instance a5dfa529-383c-4f90-b557-546ba0af8f62 could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 17:05:33.947814 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-56c81f5a-60c3-4958-afec-7ec982956faf tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62" status: 404 len: 111 microversion: 2.1 time: 0.038435 Dec 13 17:05:33.948326 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 539/1081] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:33 2021] GET /compute/v2.1/servers/a5dfa529-383c-4f90-b557-546ba0af8f62 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 17:05:37.101739 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-879f6d64-bffb-4b9c-8e64-1d471580087c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:37.102297 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-879f6d64-bffb-4b9c-8e64-1d471580087c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:37.105633 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-73d27b0b-3a92-426a-9959-ce290de4f2a8 req-d6e4ac04-5f6f-4ecd-adf6-296bddef8e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad56e4eb-5642-4629-a5c9-8a11964e1bca", "tag": "360d80e6-017c-4c3b-9987-4843c26e5d73"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:05:37.108276 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:05:37.108276 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 17:05:37.109186 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-879f6d64-bffb-4b9c-8e64-1d471580087c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:37.109642 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-879f6d64-bffb-4b9c-8e64-1d471580087c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:37.110432 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-879f6d64-bffb-4b9c-8e64-1d471580087c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:37.110875 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-879f6d64-bffb-4b9c-8e64-1d471580087c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:37.116220 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-73d27b0b-3a92-426a-9959-ce290de4f2a8 req-d6e4ac04-5f6f-4ecd-adf6-296bddef8e02 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:37.116774 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-73d27b0b-3a92-426a-9959-ce290de4f2a8 req-d6e4ac04-5f6f-4ecd-adf6-296bddef8e02 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:37.128942 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-73d27b0b-3a92-426a-9959-ce290de4f2a8 req-d6e4ac04-5f6f-4ecd-adf6-296bddef8e02 service nova] Creating event network-changed:360d80e6-017c-4c3b-9987-4843c26e5d73 for instance ad56e4eb-5642-4629-a5c9-8a11964e1bca on hv-cinder-82160 Dec 13 17:05:37.134401 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-73d27b0b-3a92-426a-9959-ce290de4f2a8 req-d6e4ac04-5f6f-4ecd-adf6-296bddef8e02 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033414 Dec 13 17:05:37.135344 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 540/1082] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:05:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:05:37.139995 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-879f6d64-bffb-4b9c-8e64-1d471580087c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Going to try to terminate instance {{(pid=122886) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 13 17:05:37.228382 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-879f6d64-bffb-4b9c-8e64-1d471580087c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 204 len: 0 microversion: 2.1 time: 0.130509 Dec 13 17:05:37.229628 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 543/1083] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 17:05:37 2021] DELETE /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 13 17:05:37.238913 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-d2297a59-80ac-4675-89b1-6957b531a565 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:37.239872 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-d2297a59-80ac-4675-89b1-6957b531a565 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:37.246398 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d2297a59-80ac-4675-89b1-6957b531a565 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:37.247095 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d2297a59-80ac-4675-89b1-6957b531a565 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:37.248592 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d2297a59-80ac-4675-89b1-6957b531a565 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:37.249196 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-d2297a59-80ac-4675-89b1-6957b531a565 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:37.399698 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.policy [None req-d2297a59-80ac-4675-89b1-6957b531a565 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122885) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:05:37.408393 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-d2297a59-80ac-4675-89b1-6957b531a565 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1578 microversion: 2.1 time: 0.174201 Dec 13 17:05:37.418619 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 541/1084] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:37 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:05:38.427277 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-cbf09c77-49d7-4b5f-9f5e-e0803299ed7b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:38.427995 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-cbf09c77-49d7-4b5f-9f5e-e0803299ed7b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:38.435947 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cbf09c77-49d7-4b5f-9f5e-e0803299ed7b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:38.436392 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cbf09c77-49d7-4b5f-9f5e-e0803299ed7b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:38.437215 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cbf09c77-49d7-4b5f-9f5e-e0803299ed7b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:38.437639 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-cbf09c77-49d7-4b5f-9f5e-e0803299ed7b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:38.582852 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-cbf09c77-49d7-4b5f-9f5e-e0803299ed7b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:05:38.590495 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-cbf09c77-49d7-4b5f-9f5e-e0803299ed7b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1460 microversion: 2.1 time: 0.167489 Dec 13 17:05:38.591144 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 544/1085] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:38 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1460 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:05:39.198339 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [req-28ec1084-63f9-4578-9c83-da0f53d96055 req-80ca6244-685e-409f-a253-dd0141a451c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad56e4eb-5642-4629-a5c9-8a11964e1bca", "name": "network-vif-deleted", "tag": "360d80e6-017c-4c3b-9987-4843c26e5d73"}]} {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 13 17:05:39.199918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 17:05:39.199918 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: warnings.warn(msg) Dec 13 17:05:39.207707 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-28ec1084-63f9-4578-9c83-da0f53d96055 req-80ca6244-685e-409f-a253-dd0141a451c3 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:39.208162 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [req-28ec1084-63f9-4578-9c83-da0f53d96055 req-80ca6244-685e-409f-a253-dd0141a451c3 service nova] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:39.219622 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.compute.server_external_events [req-28ec1084-63f9-4578-9c83-da0f53d96055 req-80ca6244-685e-409f-a253-dd0141a451c3 service nova] Creating event network-vif-deleted:360d80e6-017c-4c3b-9987-4843c26e5d73 for instance ad56e4eb-5642-4629-a5c9-8a11964e1bca on hv-cinder-82160 Dec 13 17:05:39.225011 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [req-28ec1084-63f9-4578-9c83-da0f53d96055 req-80ca6244-685e-409f-a253-dd0141a451c3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030256 Dec 13 17:05:39.225602 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 542/1086] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Dec 13 17:05:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 13 17:05:39.607931 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:39.608893 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:39.615771 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:39.616218 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:39.617004 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:39.617464 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:39.649201 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:39.649565 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:39.650008 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.objects.instance [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lazy-loading 'fault' on Instance uuid ad56e4eb-5642-4629-a5c9-8a11964e1bca {{(pid=122886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 13 17:05:39.691197 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.policy [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078365e1f861436ba3fc141bf3503ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3d44ae5b7a42349c31171119f79b12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122886) authorize /opt/stack/nova/nova/policy.py:199}} Dec 13 17:05:39.701063 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-3241d03a-82a5-47ed-84f4-520a2d15564b tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 200 len: 1231 microversion: 2.1 time: 0.096732 Dec 13 17:05:39.702103 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 545/1087] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:39 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 13 17:05:40.724488 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:40.725691 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: ad56e4eb-5642-4629-a5c9-8a11964e1bca] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:40.735478 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:40.735924 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:40.736749 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:40.737184 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:40.751171 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] HTTP exception thrown: Instance ad56e4eb-5642-4629-a5c9-8a11964e1bca could not be found. Dec 13 17:05:40.751754 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Returning 404 to user: Instance ad56e4eb-5642-4629-a5c9-8a11964e1bca could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 17:05:40.752601 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-74e630b0-3863-4014-8999-e65b3972c00c tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca" status: 404 len: 111 microversion: 2.1 time: 0.036127 Dec 13 17:05:40.753115 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 543/1088] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:40 2021] GET /compute/v2.1/servers/ad56e4eb-5642-4629-a5c9-8a11964e1bca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 17:05:41.235511 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:41.236026 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.compute.api [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122886) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:41.242464 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:41.242910 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:41.243687 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:41.244119 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG oslo_concurrency.lockutils [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:41.257267 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.wsgi [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] HTTP exception thrown: Instance 5f01e078-bf24-4ea2-a973-15e33b5e166a could not be found. Dec 13 17:05:41.257817 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Returning 404 to user: Instance 5f01e078-bf24-4ea2-a973-15e33b5e166a could not be found. {{(pid=122886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 17:05:41.258667 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-d5ba3221-6e3f-4a8c-bf38-719e19299d37 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 404 len: 111 microversion: 2.1 time: 0.027984 Dec 13 17:05:41.259229 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 546/1089] 10.222.0.62 () {58 vars in 1238 bytes} [Mon Dec 13 17:05:41 2021] DELETE /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 17:05:41.267710 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '>' {{(pid=122885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:41.268313 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.compute.api [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] [instance: 5f01e078-bf24-4ea2-a973-15e33b5e166a] Fetching instance by UUID {{(pid=122885) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 13 17:05:41.274637 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:41.275082 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:41.275853 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 13 17:05:41.276256 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG oslo_concurrency.lockutils [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Lock "31ce76d4-9fe4-4b8d-a79f-c827d49740a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 13 17:05:41.289959 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.wsgi [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] HTTP exception thrown: Instance 5f01e078-bf24-4ea2-a973-15e33b5e166a could not be found. Dec 13 17:05:41.290538 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: DEBUG nova.api.openstack.wsgi [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Returning 404 to user: Instance 5f01e078-bf24-4ea2-a973-15e33b5e166a could not be found. {{(pid=122885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 13 17:05:41.291345 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO nova.api.openstack.requestlog [None req-44fb1d4f-e86c-441a-98f0-2f0d21f6c355 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a" status: 404 len: 111 microversion: 2.1 time: 0.027728 Dec 13 17:05:41.291856 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: [pid: 122885|app: 0|req: 544/1090] 10.222.0.62 () {58 vars in 1235 bytes} [Mon Dec 13 17:05:41 2021] GET /compute/v2.1/servers/5f01e078-bf24-4ea2-a973-15e33b5e166a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 13 17:05:42.626070 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: DEBUG nova.api.openstack.wsgi [None req-7edc1233-bd23-40e0-9f74-8e11ba4427f5 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] Calling method '.version_select at 0x7f213bf0f0d0>' {{(pid=122886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 13 17:05:42.652474 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO nova.api.openstack.requestlog [None req-7edc1233-bd23-40e0-9f74-8e11ba4427f5 tempest-TestVolumeBootPattern-1140465859 tempest-TestVolumeBootPattern-1140465859-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1391205097" status: 202 len: 0 microversion: 2.1 time: 0.030750 Dec 13 17:05:42.653153 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: [pid: 122886|app: 0|req: 547/1091] 10.222.0.62 () {58 vars in 1262 bytes} [Mon Dec 13 17:05:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1391205097 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 13 17:06:35.012507 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:06:35.013750 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: Mon Dec 13 17:06:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:07:02.158800 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:07:02.159730 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 17:07:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:07:32.831393 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:07:32.832495 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 17:07:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:08:28.429955 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:08:28.430950 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: Mon Dec 13 17:08:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:08:37.135811 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:08:37.136810 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 17:08:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:09:55.042276 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:09:55.043325 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: Mon Dec 13 17:09:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:10:22.186501 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:10:22.187311 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 17:10:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:10:47.670240 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:10:47.671178 dv-cinder-821602-2-iscsi devstack@n-api.service[122886]: Mon Dec 13 17:10:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 13 17:10:52.855752 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 13 17:10:52.856411 dv-cinder-821602-2-iscsi devstack@n-api.service[122885]: Mon Dec 13 17:10:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!